Web Crawler Freelancers

Browse Web Crawler job posts for project examples or post your job on Upwork for free!

Web Crawler Job Cost Overview

Typical total cost of Upwork Web Crawler projects based on completed and fixed-price jobs.

Upwork Web Crawler Jobs Completed Quarterly

On average, 163 Web Crawler projects are completed every quarter on Upwork.

163

Time to Complete Upwork Web Crawler Jobs

Time needed to complete a Web Crawler project on Upwork.

Average Web Crawler Freelancer Feedback Score

Web Crawler Upwork freelancers typically receive a client rating of 4.69.

4.69
Last updated: June 1, 2015
More options
Clear all filters
  1. Alexander Basanov

    Alexander Basanov

    Web crawler

    Russia - Last active: 26 days ago - Portfolio: 1

    Hi, I'm really expert in web crawling. Google, facebook, craiglist and many others crawlers. Emails and phones searchers, and websites by keword searcher. My crawlers are scalable, i use Amazon.AWS for it and proxies if needed. Recognize captcha is not trouble for me. I have online email scraping service http://mailtarget.org/ You can give me a test task for test me for free Regards, Alex

    $40.00 /hr
    67 hours
    4.70
  2. Anant Vijay Soni

    Anant Vijay Soni

    QA/Software Testing - Web Research - Web Crawler

    India - Last active: 3 days ago - Tests: 16 - Portfolio: 7

    Your Satisfaction is My Goal Which I Will Try My Best to Approach . I can speak fluently English, Hindi (Indian). Having excellent verbal and written skills makes me a contractor worth having! I am hard-working, reliable, efficient, good-management time, punctual person. I always want to make things done with highest quality as possible. I am an experienced research specialist, software & Web testing, data entry etc. I have a great eye to focus on task details . 4 years of Tester experience in Manual and Automation Testing of WEB and MOBILE applications. Expertise in Manual Testing (Functional Testing, Integration Testing, Usability Testing, Compatibility Testing, Regression Testing, System Testing) and Automation Testing (Functional Testing and Performance Testing) Creating Test plans/Scenarios/Test Cases for carrying out tests at various development stages through functionality, regression testing. Solid technical skills of Automation Testing Skills of Functional Testing, Load testing, Stress Testing and Usability Testing of web application developed in java, .NET and PHP technologies. Perfectly familiar with SDLC & STLC, V-model, Waterfall, Scrum, Agile. I'm looking for long-term or part time project. Application Testing Skills: * Functional Testing, Automated Web Functional Testing * Security Testing, Usability Testing, Performance Testing, Load Testing, Stress Testing, Accessibility Testing Automated Testing Tools Skills: * QTP 10.0, Load Runner, Quality center 9.0 Bug Tracking System Skills: * Bugzilla Communication: Gmail and Skype

    $5.67 /hr
    122 hours
    4.88
  3. Jane America

    Jane America

    Data Entry Professional, Web Researcher, Web Crawler,Computer Literate

    Philippines - Last active: 2 days ago - Tests: 8 - Portfolio: 1

    Accurate, fast keying skills and sound knowledge of computer applications. Proven ability to collect and manage information efficiently and accurately. Skilled in planning and organizing with the ability to complete tasks on deadline. An independent worker who successfully meets the challenges of a fast-paced environment providing data entry and administrative support to a large department. Sound knowledge of database management tools and data entry technologies. A proven track record of efficiency and accuracy in managing multiple functions, solving problems, maintaining confidentiality and producing quality work. Becoming the best trainee in TESDA on I.T. courses. On The Job Trainee as data entry clerk in municipal hall. Works in Landtax Office for (SPES) Special Program Employment for Students.Currently working as Hiring Manager of Social Media Group.

    $5.56 /hr
    1,526 hours
    5.00
  4. Dave M.

    Dave M.

    Perl, Python programmer, web scraping / data extraction

    United Kingdom - Last active: 1 day ago - Tests: 5 - Portfolio: 1

    I am a freelance software developer providing web scraping services and data crawling using Python and Perl. Over the last 5 years, I have developed a wide range of software solutions to crawl and extract different types of data from a myriad of websites, e.g. real-time data, business listings, sports results data and other related data sources. My experience lies in automated web scraping with well defined specifications including website and output format. Website data delivered often are in standardised CSV or SQL formats and typically involves further post-processing of crawled data according to your requirements. Code is written in Python and Perl following agile and TDD software design techniques to ensure code longevity, reliability and robustness. I also have experience in mathematical languages Matlab, R, as well as databases SQL, MongoDB, Linux administration, and many web API's including Dropbox, Twitter, Twilio and Sendgrid. As well as web scraping, I am capable of completing similar web related projects using Python and Perl, for example, filtering log files, web monitoring, notification systems and backend web apps. Please contact me if you have any available projects!

    $66.67 /hr
    519 hours
    4.92
  5. György George Csala

    György George Csala

    top-grade, full scale software developer

    Hungary - Last active: 2 days ago - Portfolio: 3

    I'm an expert high capacity scraper builder. (Amongst some 12 other major areas of operation in IT and software development.) Most likely the best of the few top scrapers on Upwork (and Elance). I can write software in Phyton, Javascript, VB.net, C#, C++, Java, PHP, VB6/VBA and other scripting languages. More than 15 languages. Also, I have intermediate web programming and web operations knowledge. (Ie. setting up an optimized server farm with up to 5000 servers.) My scraper softwares extracted far more than 1 billion (!) data rows since Feb 2008. I wrote more than 2 million (!) lines of code since 1986. I test code and also data quality in depth. Data quality is the missing ingredient in almost all programmers. In part time, I'm a special Software Quality Management Engineer known for wide spread knowledge of software QA ensuring REAL software quality from the conception through well established sales activities and finally good delivery for almost any software product or service. Part of this is being a Software Application Security expert. (Software Quality Management Engineer is a top management post. It is called engineer because it uses wide range of exact technologies.) Your satisfaction is guaranteed anytime I undertake a job small or large! I don't want to into more details, because it may seem very complicated and hard to understand. However, one of my major policies is that I need to make software use as simple as possible for users. And as convenient as possible. Within reasonable usage of development time and resources. Correctly working systems is the most major policy. It is extremely hard to attain. (Not even big companies can do this! None of them! Check out their user forums!) And sorry, don't compare my efficiency, speed, skill and correctness of work to others with less than 20 years experience ! It can't be compared ! Because I have much wider experience and knowledge base. Just to give you a proper performance comparison. I've been work my on Office like product which has approximately 5 times usage value and functionality of any Microsoft Office including Word, Excel, Access and OneNote. But I only use 1/1000 or less of resources MS had used and I'll have a 5 times better product in functionality and convenience. So, this is my efficiency. Even if it doesn't apply fully to scraping projects, I can do 3-10 times better scraping than any practiced individual. (It can be even 200 times better in rare cases.)

    $44.44 /hr
    53 hours
    4.93
  6. Vinoth kumar K.

    Vinoth kumar K.

    Web Scraping Expert, Automation Developer - Web/Desktop(Linux,Win,OSX)

    India - Last active: 1 day ago - Tests: 7 - Portfolio: 6

    - Web Scraping/Crawling - using NodeJS(Request+CheerioJS), PhantomJS/CasperJS, Python (Scrapy/BeautifulSoup), PERL(Mechanize/LWP) & Java(HtmlUnit), Selenium (and making it headless with XVFB) - General Automation (Web/Browser/Desktop) - Greasemonkey/Tampermonkey scripts - General Scripting (Javascript, Python, PERL, Shell Script) - UNIX command-line tools, VIM Try me. You won't be disappointed. What have I got to offer? I’ve got some really good experience & expertise in automation (web & desktop - Linux, Win & OSX), quick scripting & general coding. You can always trust me with almost any automation/coding requirements (ex. unix command line tools, developing quick scripts, tweaking existing scripts, web scraping/crawling, creating APIs) at a fair price and a very quick turnover. When delivering a piece of code/script, I’ll make sure that it is professionally written (to the highest quality & efficiency) and that it has a proper README file (on using it in your local system/host). Exclusive Experience? Web scraping & web crawling are clearly a part of automation and just here in oDesk, I’ve scraped close to 300 websites (all types - static pages, javascript/AJAX heavy websites, CAPTCHA posing websites, IP banning websites etc.) and I’m pretty comfortable with this. About me? I’m passionate about coding and so I always keep learning something new or look around github for some interesting projects to contribute. To me all programming languages are just a set of syntax rules - anyone with strong DS & Algorithm knowledge can learn and master them in days/weeks. Preferred OS: Linux, Preferred Editor: vim If at all you want to interview me, I’m available at Skype (ID: vdraceil) Looking forward to many great work experiences.

    Groups: Sun Certified Professionals

    $44.44 /hr
    289 hours
    5.00
  7. Eugene B.

    Eugene B.

    Architect Developer

    Belarus - Last active: 24 days ago - Tests: 12 - Portfolio: 2

    - 20+ years experience in Business Applications consulting, desing and development - big international experience - Web Application Development: full stack, with focus on PostgreSQL or MySQL, Zend Framework (php), jQuery or Dojo - Unity 3D for augmented and 3D applications - SAP Business Intelligence, SAP Business Objects - Salesforce.com

    $33.33 /hr
    0 hours
    5.00
  8. Alexander C.

    Alexander C.

    Scala / Java / Haskell developer, Full Stack Engineer, Consultant

    Russia - Last active: 05/31/2014 - Tests: 2 - Portfolio: 2

    Java developer with 8 years of experience. Now also Groovy(2 years) and Scala(1.5 years) developer. Java: Hadoop, Nutch , Lucene/SOLR/ElasticSearch, Morphia(MongoDB ORM), parsers/crawlers(using Apache Httpclient, HtmlUnit and own microframework), Web MVC(Struts 1.x/Grails), Java Desktop Applicatins(Swing) / Applets, webservices (w. Restlet framework), RabbitMQ Java client, Riak Java Client Scala: PlayFramework 2.x, Lift, Akka, ReactiveMongo Groovy: Groovy scripts / Gant build scripts / Gradle Databases: SQL(PostgreSQL/MySQL), MongoDB, Riak, SOLR/ElasticSearch PHP scripts, linux(fedora/centos/ubuntu) server administration, SVN / Git, SEO methods/scripts, affiliate marketing. Check my blog(chepurnoy.org)/GitHub(kushti) also.

    $60.00 /hr
    1,026 hours
    4.99
  9. Adam F.

    Adam F.

    Web programmer/scraper/data-mining (HTML, PHP, MySQL, CMS, REGEX)

    United States - Last active: 12/19/2014 - Tests: 1 - Portfolio: 3

    I was a graphic/web designer for several years before I moved on to IT Management, but I specialize in data-mining/web-scraping. I have developed scripts that quickly harvest information, present it to the user in an organized fashion, and automate arduous processes. Some examples include: - Statewide Craigslist Search - Setting up sites that use "Bookmarklets." Say, for example, rather than mining an entire site, you want to strip individual products. You view a product and click the bookmark in your browser that will then redirect to the data-mining script with the web site you were just viewing. From there it will process the information as needed (create your own product database without having to scan your own images). - Mass file/image harvesting which can be exported as new-line delimited URLs that can then be easily imported into most download managers to later retrieval. - Custom databases for personal use by mining information from other sites (i.e. Movies, Comics, etc.)

    $38.89 /hr
    0 hours
    5.00
  10. Bruno Gola

    Bruno Gola

    Python Programmer and GNU/Linux System Administrator

    Brazil - Last active: 03/13/2014 - Tests: 1 - Portfolio: 2

    I'm mainly a Python programmer and GNU/Linux / *nix system administrator. I have some experience as a C programmer as well. I have experience with web programming and also with audio (ladspa/lv2 plugins and hosts), working for the http://portalmod.com project. I love writing system/utility scripts, chat robots and web crawlers as well :)

    $33.33 /hr
    0 hours
    5.00