Python Scrapy Freelancers

Clear all filters

Nawazish ul Qadir

Nawazish ul Qadir

Python, django, Rest APIs, web scrapy framework, Sencha touch Expert

Pakistan - Tests: 1 - Portfolio: 8

My work speaks for itself and I am happy to make changes until you are happy. I am not going to bore you with a marketing style write-up about how great my coding is and how versatile. If you want a serious programmer, freelancer or researcher, within python, php, sencha touch or Moovweb, that would be me. I have been working in python for a long time. Python Scripting (php to python) conversion Python script writing (download, upload) files on ftp, files data parsing(json,csv), Regex and string modules, text processing. 3rd party libraries(urllib2, BeautifulSoup, Requests, lxml) Social media APIs expert(twitter, facebook, linkedin) etc Scrapy framework expert for web scraping to get the useful data including the images data from ecommerce sites. django framework, Restful APIs development (big data) python with Mysqldb and Nosql(mongos) Google geocodes and google maps expertise. Real estate data expert (large data)

$8.89 /hr
774 hours

Alexander K.

Alexander K.

C#/PHP/Python , Web scraping , Senior Linux System Admin

Russia - Tests: 5 - Portfolio: 4

Over 11 years of experience in development, I've acquired some good knowledge in a variety of technologies from C# programming on Desktop Windows Application to Linux Server solutions PHP, Python. I've been developing Web Scraping Systems, I also have hands-on experience on Third-party API integration. Selenium Web Driver, Scrapy, Html Agility Pack My programming style is clean and straight-forward, with equal emphasis on quality, functionality and maintainability. Here's a summary of the technologies I've been involved with: /Python | -- Scrapy /C# Developing |-- Desktop Application |-- Network Application |-- Web Scraping Application |-- Html Agility Pack /Web scraping (on C# or php) |-- Multi-threaded scraper |-- Proxy switching |-- Javascript-based sites |-- Password/SSL protected sites |-- Image scraping |-- Ad scraping |-- Feed scraping |-- Email extraction |-- Regexp |-- Captha recognition |-- Text in image recognition |-- Deliverables in csv, tsv, xml, json, excel, mysql, txt |-- Selenium Web driver /API Integration |-- Google Maps |-- Google Streetview |-- Google Custom Search |-- Facebook API |-- LinkedIn API |-- PayPal API |-- Maxmind.com (IP Geolocation tools) |-- Clickatell.com (Bulk SMS Gateway) |-- Oneall.com (Social Login) |-- Octeth.com (Email Marketing Software) |-- Adstation.com (Advertising Software) |-- Ekosolutions.us (Mobile marketing and micropayments) |-- Infofax.es (Internet Faxing) |-- Prosperent.com (Affiliate tools) |-- Superfish.com (Visual Search) |-- Wurfl.sourceforge.net (Mobile Useragent Database) |-- Talentbin.com (Talent Search Engine) |-- AWeber.com (Opt-In Email Marketing) |-- Thumbalizr.com (Online thumbnail generator) |-- Fnac.es (Product Catalog) |-- Serhstourism.com (Hotel Search Engine) / PHP |-- CodeIgniter Framework |-- Symfony Framework |-- MeekroDB |-- Xdebug |-- Web services |-- PHPUnit |-- Exception Handling |-- cURL |-- PHPMailer |-- phpDocumentor |-- Memcache |-- ZB Block /Javascript |-- jQuery |-- jQuery UI |-- jQuery Grid |-- jQuery Dump |-- jQuery slimScroll |-- MooTools |-- YUI |-- jSEND |-- qTip2 |-- Conditional compilation |-- DOM manipulation |-- Namespaces |-- Ajax /Linux |-- Apache |-- htaccess |-- Shell scripting |-- Rsyc/SSH |-- Cron jobs |-- Procmail |-- Memcached |-- GNU gettext |-- FFmpeg |-- yum/apt-get |-- Virtual hosts |-- Plesk/cPanel |-- other /MySQL |-- Transactions |-- Large databases (~5M rows) |-- Data replication |-- Fine tuning |-- Backups /Project Management Tools |-- Git/GitHub |-- SVN |-- Trac |-- Pivotal Tracker |-- Basecamp |-- Atlassian |-- Balsamiq Mockups /Other |-- C/C++ |-- Java |-- Html |-- Lua |-- Delphi

$33.33 /hr
24 hours

Gabriel Moncarz

Gabriel Moncarz

Data Scientist - Computer Engineer - Python developer

Argentina - Tests: 5 - Portfolio: 2

Data Scientist, Computer Engineer,  Magister in Quantitative Finance and Magister in Data Mining and Big Data. After working for a decade as a backend software developer, I decided to leverage my knowledge and find new multidisciplinary challenges. I started as a Data Scientist developing quantitative trading algorithms to apply in stock markets. My enthusiasm to model random process made me complete a Master in Data Mining and Big Data, and another in Quantitative Finance. Since then I have created models for banks, astrophysics, the internet domain and financial industry. I am not a standard data scientist. I am not a model applier. I have studied the implementation details of most well known machine learning algorithms, allowing me to customize each one according to the nature of the working problem. Programming (currently): Python Programming (past): R, Perl, Java and Ansi C. Machine Learning Models: Naive Bayes, Fisher Lineal/Cuadratic Discriminant Analysys, Nearest Neighbor, Multivariate, and Logistic Regression, Decision Trees (Chaid and CART), SVM, Neural Networks (Backpropagation, CPN, SOM, etc), Genetic Algorithm and PSO. Clustering: Hierarchical, K-Means, Fuzzy C-Means, EM, DBSCAN, OPTICS, Clara and PAM. Ensembles: Random Forest, Bagging and Boosting. Hadoop: Map/Reduce, Pig, Hive and Spark. Cloud Services: AWS and Azure.

$45.00 /hr
4,281 hours

Carlos L.

Carlos L. Agency Contractor

Tailored Solutions Specialist

Costa Rica - Tests: 2 - Portfolio: 3

Since 2002 I've been developing an assorted variety of websites or sections of them, using different technologies from HTML, Javascript, jQuery and CSS to server side mainly PHP and the whole .net environment, interacting with MySql and MS SQL database engines.Most of the recent projects revolve heavily around Ajax.Involved lately in Django/Python technologies, developing some internal projects and standardized to the platform but anxious to jump into something bigger.

Groups: Application Developers Alliance

$55.56 /hr
3,454 hours

Ehmad Z.

Ehmad Z.

I love iOS

Pakistan - Tests: 3 - Portfolio: 5

I'm a Software Engineering graduate from the best university in Pakistan. I started software development with building Facebook Canvas and Page Apps. Thereafter, i started working in Android for about 6 months and right now i'm working for edX (www.edx.org) developing their iOS App. I like to think of myself as an out of the box thinker and a problem solver. Adhering to deadlines is of utmost importance to me. Last but not the least, i am a photographer, videographer and short film maker by passion.

$40.00 /hr
43 hours

Ingvar Kovalkovskyy

Ingvar Kovalkovskyy

Drupal, PHP, Python; Special Situations Developer

Ukraine - Tests: 18

Delivered first website back in 1998. Since then, I went through all the roles in web development, from HTML to SQL to PHP to high-performance tuning, including sysadmin tasks. I specialize in maximizing ROI, fine-tuning business processes, online promotion and advertising. Project management. I understand all the aspects of web development and promotion, so I know how to choose sub-contractors that deliver first-class results. My core competency lies in complete end-end management of a new website development project, and I am seeking opportunities to build websites from the ground up for you or your business. I also have some experience in the following areas: SQL, NoSQL, nginx, Lighttpd, Apache, Varnish, Ajax, OOP, and software design and testing.

Groups: Drupal

$33.33 /hr
18 hours

Justin Lee

Justin Lee

Software Engineer

United States - Tests: 1

I consider myself a multidisciplinary engineer, with backgrounds in biological, biomedical, chemical, and mechanical engineering. Currently Django Web Developer. Languages -Python -ANSI C -Java -Javascript -Bash -Shell -CSS/HTML5 -MATLAB -MySQL -MongoDB -SQLite3 Frameworks/Tools -Android -Django -Flask -Arduino -Chef -Ansible -Scrapy Serivices -AWS -Linode Additional Information: American-born (US Citizen) software engineer currently residing in Washington state (Pacific Time).

$66.67 /hr
0 hours

Boian M.

Boian M.

16yr exp - Linux Systems Architect / ISP / IT Consultant -

Bulgaria - Tests: 3 - Portfolio: 3

* gathering customer's requirements (type of applications deployed) * specifying hardware * deploying (software and hardware installation, including in data centers) * technical writing on cloud-computing topics, security, High-availability, clusters and others * monitoring / profiling * management * architecture audits * virtual infrastructures based on KVM / OpenVZ / VMware / XEN / Sun Ray + Virtualbox * Fully-virtualized and HA architectures deployment (Proxmox, ESX, OpenStack) and network virtualization (Neutron); * network solutions based on Brocade / Cisco / HP / Mikrotik products * full internet provider development * providing adequate documentation in each stage (doc/pdf/Visio) of Linux/UNIX based systems, also managing small IT teams, looking for new challenging projects. * BIND, djbdns, mydns, ndns based DNS architectures; * Qmail / Exim / Postfix-based mail systems; * Websystems to include Apache / MySQL / PostgreSQL / PHP / Perl configurations; * Rails solutions; * Complete webhosting managment - Cpanel/WHCMS /Plesk etc.; * Backup solutions (EMC Retrospect, Open source solutions - Bacula, Amanda, ZRM etc.); * Cloud computing IAAS and PAAS(Amazon EC2, OpenStack) and related ecosystems (Ceph); * HA solutions : Pacemaker, Corosync, GlusterFS, MooseFS, DRBD, Ceph * Load testing (jMeter, Tsung, iozone, vdbench, ab, siege); * MySQL - single servers, Master/Slave configurations or Master/Master; * Tomcat/Resin based Java application servers; * Monitoring deployment and administration (Zabbix, Nagios); * Nagios / MRTG / Cacti monitoring and data acquisition; * Design/development and modification of PHP/Ruby/Perl-based web systems; * MVC framework development on Rais / CakePHP / Codeigniter; * Zibra, Zarafa, iRedMail, phplist, google apps, Also extensive experience in deployment and management of server configurations in data centers.

$50.00 /hr
6,882 hours

Karthikeyan J

Karthikeyan J

Expert Programmer with Scraping/Parsing/Crawling/Data Mining skills

India - Tests: 3 - Portfolio: 3

Im Karthikeyan as a freelancer believe that my success depends on the benefit my clients receive on choosing to work with me. I have 4+ years of experience in PERL scripting language, Data Harvesting, Scraping/Crawling and Web research, etc. I assist five individuals and we work here as a team. I go extra miles for my clients to make them happy and most satisfied. I believe that only satisfied clients and happy team members make a business successful. Our values are reflected in our interaction and we are passionately dedicated to delivering over and above what has been expected. I strive to keep up high standards of service and make sure that every recommendation I make to help you meet your goal is only after careful analysis and research. What I do – Our Offerings Data Aggregation Services: • Data Engineer in Data Extraction, • Data Clustering, Data Transformation, • Data Aggregation, Data De-Duplication, • Data Normalization, Data Classification & Data Clustering. • Data Cleansing • Data Mining • Data Enrichment • Data Standardization • Product Taxonomy Development • Duplicate Identification • Competitor Cross Reference • Competitor Price Analysis • Data Migration • Data Feed Creation Shopping Cart Solutions: • Magento Product Upload • Yahoo Store Data Entry • X-Cart Product Entry • BigCommerce Product Entry • Zen-Cart Product Entry • Shopify • OpenCart Product Upload Product Catalog Management Services: • Catalog Building & Indexing • Catalog Content Management • Catalog Conversion • Product Classifications • Image Editing & Resizing SEO Services: • OnPage Optimization • Shopping Cart SEO • eCommerce Website Analysis Graphics Design Services: • Icons design for applications • Banners and other web graphics • Logo design for web or print use Image Editing Services: • Image Retouching • Image Resizing • Image Conversion • Image Enhancement • Image Background editing I offer a "no obligation" free trial, because Im are confident that once you experience me, you won't think of going anywhere else! Our Specialization • Expresso Regex Software • Microsoft Office • Abby transformer • visual Web ripper • DQS • C • Perl • SQL • HTML • Java Script • MS office • Web Designing, • LOGO Designing • Photoshop. Why hire me • Outstanding client support • Experienced professional service • Great teamwork • Enhanced Flexibility • Improved Execution Quality • Operational excellence • Create more customer satisfaction • Free Trial • 24*7 support My footprints * Scrap Companies information from SEC (U.S. Securities and Exchange Commission), Registration Authority, Regulation Authority, Public Websites. * Scrap Product information from E-Commerce sites like eBay, Amazon, Wall mart, Yahoo! Auctions, Craigslist and Overstock etc. * Scrap store location and Company address from Google Maps, Yahoo Maps, Google plus and company websites. * Scrap Stock Information and Companies Financial data from Stock Exchange(NYSE, NASDAQ, London SE, ASX, BSE, NSE) and Third Parties(Google Finance, Yahoo Finance, Investorsec, OCT:BB, MSN Finance, Bloomberg Business week, Market Watch, Reuters, S&P, Investor Guide. * Scrap Product Information and Companies Information from API's like eBay API, Amazon API, Google API, Yahoo API, Shopzilla API, Wikipedia API etc. * Automation Projects like File Conversion, Creation of mailing lists by scraping emails from websites, Document Cleansing and Consolidation, Clustering similar data to identify duplicates, SERP scraping and Page rank scraping, price comparisons from different websites, Document Download/Upload, FTP Download/Upload etc. Looking forward for working with you. Thank You.

$4.46 /hr
921 hours

Anton Troyanov

Anton Troyanov

Software Development Expert

Russia - Tests: 2

I have more than 10 years of software development experience. Over the last 7 years, I worked as a Team Leader and Software System Architect on different projects starting from web applications and ending with a high-performance back-end services for real-time systems using .NET/MS stack of technologies. At present I work as a Head of Software Development in a team that builds 'connected car' (IoT) technology for automakers. My core competency lies in a complete management of a whole development process including device firmware and cloud computing infrastructure as well as applications for mobile devices under iOS and Android operating systems. I also have experience with program languages like Python (Django, Flask, Tornado and Scrapy) and Go. At my free time I'm learning F# and Scala. Databases: MS SQL Server, MySQL, SQLite, MongoDB, PostgreSQL Application / Web Servers: IIS, nginx, Apache, Tomcat MQ: ServiceBus, RabbitMQ + MQTT Platforms: Windows, Mac OS X, Linux, FreeBSD Cloud services: Azure, Amazon AWS Other tools: git, JIRA, YouTrack, Redmine, TeamCity, TestRail I like everything that is somehow connected to software development and looking forward to learn something new.

$30.00 /hr
14 hours