Automated scraping solutions developer with 10+ years of experience
Last active: 2 days ago
I have 10+ years of experience as developer for automated web scraping and crawling solutions using Perl, PHP and Python with MySQL/PostgreSQL/MongoDB database backends.
Last 3 years I use mainly Python and Scrapy Framework and has developed about 100 different scrapers and crawling for wide range of purposes like gathering information from different types of business directories, ecommerce sites and directories, social networks, review sites, event schedules, transport schedules etc.
Also have a good knowledge in DevOps, system administration and highload web apps and strong skills in set up and administration of Unix-like OSes (Linux/Centos/Ubuntu and FreeBSD), Web servers (Apache, Nginx), DB(MySQL, PostgreSQL, MongoDB, Redis).