Scraping Python Freelancers

Clear all filters

Dave M.

Dave M.

Perl, Python programmer, web scraping / data extraction

United Kingdom - Tests: 5 - Portfolio: 1

I am a freelance software developer providing highly efficient web scraping and data crawling services using Python and Perl. Over the last 5 years, I have developed code to crawl and extract different types of data from numerous sources including e.g. real-time data, websites requiring authentication, business listings, real-estate, and sports results websites. My expertise lies in automated web scraping of extremely hard to get data, websites with little or no structure and difficult to parse, large scale websites, websites having strange protocols and authentication, those using 'scraping protection' services, and sites that simply put - no-one else can scrape. I use a variety of methods of getting the data and aim to obtain the data as quickly, accurately and efficiently as possible. I prefer if the project contains well defined specifications including website urls, keywords, search terms, preferred output format and update frequency. Data output usually is in CSV or SQL format and includes further post-processing of crawled data according to stated requirements. My source code is written in Python and Perl, using version control Git and following agile and TDD software design techniques to ensure code longevity, reliability and robustness. I prefer writing my own code but I also use websites and tools such as Selenium, to further increase my productivity. I have experience in other languages Matlab, R, C++ for statistical analysis as well as databases SQL, MongoDB, and experience in Linux administration and many web API's including Dropbox, Twitter, Twilio and Sendgrid. I also have completed and delivered a number of web related projects using Python and Perl including multi-threaded applications, log file filtering, web monitoring, notification systems and web apps. Please contact me if you have any available work.

95% Job Success
$66.67 /hr
536 hours

David Mestre

David Mestre Agency Contractor

Python, Web Scraping, Data Analysis, Data Science

Spain - Tests: 9 - Portfolio: 2

- Data cleaning, data analysis, modeling and simulation techniques using Python - MySQL/MongoDB/Sqlite/Sparql/Postgresql - System administration - Machine Learning - Web scraping/crawling with python - Parsing xml/csv/json - AWS servers - Python libraries: pylab, scipy, pandas, matplotlib, ggplot, seaborn, bokeh, numpy, csv, re, json, urllib, urllib2, socket, httplib, sklearn, BeautifulSoup, selenium, requests, lxml, xml, sys, so, subprocess - IDEs: iPython notebook, Komodo Github:

Associated with: Silver Seahog

94% Job Success
$40.00 /hr
1,165 hours

Richard Penman

Richard Penman

Python programmer specializing in web scraping

Australia - Tests: 2

Hi there - for the last few years I have specialized at web scraping. In this time I have extracted data from websites that require parsing JavaScript/AJAX, using proxies, solving CAPTCHA's, and contain millions of records. I prefer to quote a fixed fee for projects, so that clients have confidence about the total cost and I have incentive to be productive. I use Amazon's EC2 for my web crawling infrastructure. I can provide scraped data in whatever format is required: CSV, XML, MySQL, etc. (Most clients prefer CSV.) Much of my web scraping infrastructure is open sourced to make sharing solutions with clients easier: I also make websites that run on Google App Engine (free hosting) with web2py. I speak native English, fluent Esperanto(!), intermediate Mandarin, and basic Korean. Feel free to contact me to discuss your project. (Note that I will not work with adult related websites.)

97% Job Success
$50.00 /hr
130 hours

Anton Bynduk

Anton Bynduk

Network engineering / Python / Data Scraping

Ukraine - Tests: 5

Network administrator with 8 years experience. Last 3 years work on position lead network administrator in Wireless ISP. Extensive experience in administration, configuration, maintenance, engineering and troubleshooting networks. Worked with devices of different vendors such as Cisco, Dell, HP, Dlink, Mikrotik, Ubiquity, Motorola etc. Strong knowledge of server infrastructure. Certified CCNA and MTCNA. Strong python skills. Listed below are some my experience and skills. TCP/IP, IPv4, BGP, OSPF, STP, VLAN, QinQ, LACP, PPP, DHCP, DNS, L2 & L3 VPN, IPSec NAT, Remote access, LoadBalansing, Firewall, SIP, VoIP, Linux/UNIX

99% Job Success
$16.67 /hr
80 hours

shekhar samanta

shekhar samanta

Web Scraping Expert with Python Experience

India - Tests: 8 - Portfolio: 9

Over the last 5 years , I have worked on multiple projects ranging from big to small business needs. Timely completion of project & communicating progress updates is key for any successful job completion. Mentioned below are set of services I specialize on odesk. 1.Web scraping, crawling / Automated data extraction 2.Email extraction /scraping 3.Website development - dynamic & static 4.Data manipulations ETL 5.Image scraping /automated re-sizing, processing, uploading, stack 6.Data mining 7.Excel automation projects using VBA, Dashboards 8.& many more I primarily use python programming language & majority of scrapers/crawlers are built using Python libraries. For web development i work on wordpress & flask My objectives are always to deliver client a solution as a product, so that they can use it in future as well with least difficulties or expertise required. You can see under my profile - work history and associated client reviews for the list of jobs I have completed successfully so far with amazing ratings.

91% Job Success
$8.00 /hr
3,747 hours



Professional PHP Developer and Web Scraper

Turkey - Tests: 6 - Portfolio: 33

Top-notch web scraping expert using PHP/cURL, having scraped hundreds of sites with billions records. Always deliver perfect quality with quick turnaround. Craigslist, Yipit, Crunchbase, Twitter and Instagram are just a few examples. My major expertise is web crawling / data minning, I am also interesting in solving complex challenges, difficult problem solving, and learning to enhance my programming skills with PHP programming language. I prefer to work for short-time but difficult projects. So I can give my experiences to the task effective. I have a degree in Computer System & Engineering and have 15 years experience coding. I have been working in the hosting industry (Hostgator, GoDaddy, Bluehost) for more than 10 years and highly experienced using hosting software such as WHM / CPanel / Plesk / Virtuozzo / Webmin / Virtualmin. (Installation and Management) Technical background; I began programming on C64s with QBasic language in the 1990s. Following graduation, I developed various programs with Borland Delphi for computing hardware faculty from 2000s, and I am still programming for the automotive industry (OBD/OBD2). I professionally created various web development projects with PHP and Perl languages since 2002. I began working with FreeBSD in 2002 and Linux in 2004 and I have been working as an hostadmin for various servers like Debian and Ubuntu operating systems since 2005. I have founded to BACOMputer, which my first company on 2005, and I am still working as a project manager for my own company. I began working with clients through oDesk since 2009, and I have successfully completed many contracts between 2010 - 2015. The subjects of my recently works; ° Web scrapping / mail scrapping with PHP/cURL. My PHP codes also can be run as standalone programs on the linux shell and/or with crontab. ° PHP-MySQL works / Admin Panels. ° Delphi or PHP based text file conversion programs. ° Hosting services and transfers. ° OpenVPN authentication systems (PAM / Google Authenticator / MySQL / LDAP / Radius) ° Creating Wordpress plugins and themes. HTML to Wordpress. * OPEN-WRT Linux distributions. ° Malware code cleaning on the sites and servers. (I have developed my own tools for finding malicious codes and infected files as quickly and efficiently) ° Decompiling/Tracing Flash applications/games. ° Radio, Audio stream program installations and configurations. Shoutcast, Icecast and Flashcast solutions. ° Software installation on Linux. Ftp servers, Apache, Nginx, PHP and MySQL installations/configurations. ° jQuery and resolving jQuery issues and conflicts. ° JWplayer, Flowplayer video player installations and delayed messages/auto redirecting projects ° Lightbox, Greybox, Laytbox and other jQuery (auto) popup/popunder solutions. Locked pages with javascript alerts. ° .htaccess works (Mass redirections, SEO based links, permalinks)

100% Job Success
$45.00 /hr
1,537 hours

Alexei S.

Alexei S.

Certified PHP developer, senior back-end engineer

Russia - Tests: 9 - Portfolio: 8

TOP 25 oDesk Web developer - awarded several times! Successfully assembled and managed distributed teams. Are your freelancers taking a piss? I reviewed, fired and forced bad coders to return money and I staff professional people on oDesk. Certifications: Zend Certified PHP5 Engineer, Zend Certified PHP 5.3 Engineer, Zend Framework Certified Engineer. Oracle Certified MySQL developer. Unbeatable 14+ years of experience in LAMP environment. Experienced with high-load, high-trafficked sites with data/code distributed over several data centres. Worked with the best companies onsite (Germany, Australia, Thailand, Malaysia) and remotely (all over the world). Proven expertise in the following technologies/platforms/skills: PHP 5, outstanding OOP, OOA and OOD Python 2.5+, Django, Flask, etc. JavaScript (prefer jQuery, but can use MooTools and DoJo) versatile in XML solutions (along with XSLT and XPath) HTML (XHTML, W3C compliance, strict mode, CSS) MySQL 5, PostgreSQL, database optimization NoSQL (Redis, MongoDB, etc) AMPQ (RabbitMQ, etc) GIT (SVN, CVS, but really prefer GIT) GAE (Google App Engine: Python) APIs (various Google APIs, Facebook, Mailchimp, Twitter and many more) e-commerce: (osCommerce, Magento, digishop, xcart, zencart, etc) project tracking software (Assembla, Springloops, Mantis, Beanstalk and others) lots of other skills, including but not limited to unit, functional and regression testing, agile/lean methodology, team leading, security audit and more. Unsurpassed skills in fixing bad 'indian' code and salvaging projects by doing step-by-step full code refactoring without breaking live mode. Expect professional attitude, clean code, solutions that you won't need to fix after the project is finished, lots of ideas regarding your site/service, security audit, etc. For fulltime offers (more than 6+ months) there are nice options available: discount (up to 5$ per hour), 24hr support in case of emergencies (response time from 0 mins to 2 hrs). And the last, but not least, you get what you're paying for. If you prefer to use the cheapest dentist in another country to established and known stomatologist, then please do not contact me. Thank you.

Groups: Zend Certified Engineers

100% Job Success
$61.11 /hr
7,997 hours

Petr B.

Petr B.

Senior Developer, Consultant

Russia - Tests: 5 - Portfolio: 2

I have strong background in UNIX/Linux software development, Master's Degree in Computer Science. I worked on Enterprise high-load distributed hosting automation systems as a Team Leader (3.5 years in SWsoft, Inc., now called Parallels). For the last 6 years I'm running my own small software development business in Russia with primary focus on Python/Django apps. Not pure Web but often involving integration with hardware (Proximity Cards, Sensor Screens) or external systems like Payment Processing, SMS Gateways, GABRIEL (Airline Reservation System), etc. I can take an idea and turn it into a working business, through all the intermediate stages. Also I have experience of investing my own funds in my projects, so I feel the difference between "perfect code" in a month and "good enough" code that increases the revenue right now. Nevertheless, my code is very good: no copy-paste, always written with performance, flexibility and security in mind, etc. On oDesk I'm looking for (and actually find :) interesting projects with a sight on long-term fruitful cooperation. I'm also open to smaller activities (e.g., consulting) where my knowledge can be helpful.

Groups: Coding Champs

100% Job Success
$40.00 /hr
1,741 hours

David A.

David A.

Programmer and Ethical Hacker

United States - Tests: 12 - Portfolio: 26

A weary traveler who has been tried several times. Certifications: eLearnSecurity Certified Professional Penetration Tester (eCPPT) Silver/Gold eLearnSecurity Web Application Penetration Tester (eWPT) GIAC Certified Web Application Defender (GWEB) GIAC Security Essentials (GSEC) GIAC Certified Incident Handler (GCIH) GIAC Penetration Tester (GPEN) GIAC Information Security Professional (GISP) Offensive Security Certified Professional (OSCP) Offensive Security Wireless Professional (OSWP) Experience/Interests: •Custom Development of Data Mining/Harvesting/Scraping Tools and Bots •Data Manipulation and Automation •Web Development •Malware Removal •Penetration Testing, Vulnerability Assessments, Incident Handling and Reporting •Technical Writing and Documentation •Source Code Analysis •Application Security Technologies: •ASP.NET WebForms & MVC Programming (C#/VB) •Client-Side Programming (JavaScript/jQuery) •SQL Server Programming •HTML5 •PHP •Java (J2SE) •C++ •Python LinkedIn:

Groups: Application Developers Alliance, Crossrider...

100% Job Success
$70.00 /hr
884 hours

Ariel Humphrey

Ariel Humphrey

French-American IT/Internet Contract & Environmental Law Attorney

United States - Tests: 5

Ariel Humphrey is a French-American licensed IT/Internet/Entertainment Contract & Environmental/Water Law Attorney ranked "Number 1" amongst all of the top Odesk Attorneys. His activity is mainly aimed at: (i) helping IT/Internet/Entertainment (Music/Film/Art/Sports) companies/businesses to be perfectly managed from a legal and contractual perspective (to this extent, his services include drafting, editing, reviewing, proofreading, creating or translating sophisticated Contracts/Agreements in the field of Business law in general), and (ii) providing Legal Consulting/Research Services to Organizations and Individual (throughout the world) the actions and projects of which go towards protecting the Environment (Clean/Renewable Energy (Wind/Solar etc.) Projects) and more specifically Water Resources. Such Organizations and individuals may include Ecologists, Environmentalists, Hydrologists, Hydro-Geologists, Businesses, NGOs, Universities, Academics, Scientists, Beekeepers, Farmers, Engineers, Policy Makers, Lobbyists, Government Agencies, etc.) He takes care of his clients until they are fully happy with my work ! He always goes the extra mile for them no matter what! He can be reached on Skype 24/7 !

98% Job Success
$95.00 /hr
2,154 hours