Browse Web Crawler job posts for project examples or post your job on Upwork for free!

Web Crawler Job Cost Overview

Typical total cost of Upwork Web Crawler projects based on completed and fixed-price jobs.

Upwork Web Crawler Jobs Completed Quarterly

On average, 157 Web Crawler projects are completed every quarter on Upwork.

157

Time to Complete Upwork Web Crawler Jobs

Time needed to complete a Web Crawler project on Upwork.

Average Web Crawler Freelancer Feedback Score

Web Crawler Upwork freelancers typically receive a client rating of 4.69.

4.69
Last updated: August 1, 2015
Clear all filters
  1. Alexander Basanov

    Alexander Basanov

    Web crawler

    Russia - Last active: 2 months ago - Portfolio: 1

    Hi, I'm really expert in web crawling. Google, facebook, craiglist and many others crawlers. Emails and phones searchers, and websites by keword searcher. My crawlers are scalable, i use Amazon.AWS for it and proxies if needed. Recognize captcha is not trouble for me. I have online email scraping service http://mailtarget.org/ You can give me a test task for test me for free Regards, Alex

    $40.00 /hr
    67 hours
    4.76
  2. Víctor Manuel Ruiz Sáncez

    Víctor Manuel Ruiz Sáncez

    Web Developer, Data Extraction, Crawler Developer

    Spain - Last active: 1 day ago - Tests: 4

    Computer Science Bachelor Degree, with +6 years of programming experience and winner on several programming contest on Spain. · Data Crawling and Scraping: Scrapy Framework. · Prestashop: Modules, Fixes, Templates, SEO and Profiling. · Web Backend: Flask, Django and Slim. · Web Frontend: AngularJS, Knockout.js, Javascript, HTML5, CSS, Bower, Yeoman, Grunt. · Languages: Java, PHP, Python, C/C++, Erlang, . · OS: Linux, Mac and Windows. · Version Control: Git, Github, GitLab, Bitbucket. Fast, Cheap, and Reliable. Check my work history.

    $12.99 /hr
    213 hours
    4.95
  3. Rui Pimentel

    Rui Pimentel

    Web Developer with more than 6 years of experience

    Portugal - Last active: 1 day ago

    Looking for a fast, viable and cheap web application? I have the solution for you! I'm an expert with more than 6 years of experience in development of all kinds of web applications, using PHP, Mysql, HTML 5, CSS 3, Jquery/Ajax... My main area is Web Crawling, based on PHP + cURL scripts developed from source, having already worked in thousands of different crawlers. Contact me, and I can assure you wont regret!

    $12.79 /hr
    1,964 hours
    0.00
  4. Truong Long

    Truong Long

    Data Extraction / Web Crawler

    Vietnam - Last active: 2 days ago

    I am a software developer providing data extraction and web crawler using Java I build scrapers with: - Java - Xpath - Scenario-based (Rule-based) - Regular expressions - Json - MongoDB XPath is used in my Tool for identifying elements of a HTML page related to user activity. XPath can identify the text box user entered search keyword, the button user clicked on, and text user wants to extract. What is Rule-based? While user surfs the Internet using web browser, the scrapers generates extraction rule based on the user scenario. Later, the scrapers will reproduce user scenario in order to crawl and extract data based on the rule. The scrapers of a rule-based crawler and a rule-based wrapper. The rule-based crawler and rule-based wrapper must reproduce the same scenario as user scenario. In addition, the rule-based crawler and rule-based extractor must work with different languages, and encodings

    $5.56 /hr
    0 hours
    0.00
  5. Wallace Ferreira

    Wallace Ferreira

    Software Analyst/Developer

    Brazil - Last active: 2 days ago - Tests: 10 - Portfolio: 2

    Hello, my name is Wallace. I've been working with software development for over 9 years. I acquired a lot of experience developing applications using Visual Basic, C/C++, PHP and Java. My expertise is analyzing and developing Desktop and Web Applications such as: + Crawlers/Web Crawlers - Collecting and storing data from sites, documents, videos, photos, social media sites, classified ads sites, etc. + Web Data Scrappers - Extracting, parsing, filtering and storing relevant data from web pages to readable and manageable formats like Excel, CSV, HTML, etc. + Bots and Automation scripts - Extracting and making business decisions out of data from documents like PDFs, Excel, CSV, XML, TXT, etc. - Sending email reports automatically - Auto filling forms - Price comparison apps - Event notifiers + Data conversion/transformation - Transforming/Converting data between formats for import/export in different applications. - Feed generation - Report construction + API development/integration - Adding support for third parts services - Creating interfaces for communication between systems. I have developed dozens of applications for a wide range of application domains including: - E-Commerce sites (like Amazon.com, Walmart.com, ToysRus.com, etc) - Financial market - Market research groups - Medical related groups - Shipping companies - And several other personal applications. Some formats I have expertise in are: - JSON - XML - SQL - CSV - PDF - TXT - HTML - XSL - XSLX - And others Acting as an analyst and developer, I gained experience with modeling relational databases and SQL, with a focus on MySQL DBMS. Since 2009, I have been working for a company that develops software for the financial market - EconoInfo (http://www.econoinfo.com.br). In 2012, I graduated in Computer Science at the Pontifical Catholic University of Minas Gerais - PUC Minas. Over the past four years, I specialized in Java development, especially Java EE 6.0, focusing on technologies EJB, JPA, JSF, JMS and JCR. Acting as an analyst and developer, I gained experience with modeling relational databases and SQL, with a focus on MySQL DBMS. As a developer in charge of creating the EconoInfo website's interface, I also specialized in Servlets, HTML, JavaScript and CSS.

    $27.78 /hr
    999 hours
    4.95
  6. Riadh C.

    Riadh C.

    Expert in web automation

    Tunisia - Last active: 2 days ago - Tests: 2 - Portfolio: 9

    Expert in web automation, creating bots and scraping websites. With more then 6 years experiences in this field i can automate any process you want with the maximum accuracy and speed possible to a Machine. I use Java for multi-platform development so no matter what OS you got the bot will work for you. I can create light bot that do there task really quick or Human emulation bot which is the revolution of web automation field. I can bypass any kind of security from detecting ip to Captcha..

    $15.00 /hr
    378 hours
    4.93
  7. Akshay Mehta

    Akshay Mehta

    Java/J2EE/Spring/NodeJS/AWS/Web Crawling/Apache SOLR developer

    India - Last active: 6 days ago - Tests: 5

    I'm an expert Java engineer with 5+ years professional experience, and focused on OO technologies. I have an extensive background in large-scale desktop, web based systems. My core competency lies in end to end design/development of Web/SOA architecture. Expertise in full Software Development Life Cycle (SDLC) including Software Architecture, Object Oriented programming, Data structure & Algorithm, Database Design, J2EE Security, Encryption, Troubleshooting. ------------------------------------------------------------------------------------------------- Technologies: Core Java, Multi-Thread, Memory Management, Servlets, Web Crawling, JavaBeans, JDBC, Spring 3.0, Web Services (REST and SOAP), SAX and DOM Parsers, Apache Lucene, Cloud-AWS (EC2, S3, SES), Java Sockets, STUN, NAT, JMS, XML/XSD/JAXB/Apache XML Beans, Apache SOLR, JPA Web Technologies: HTML, JavaScript, AngularJS, JQuery, Bootstrap, Node JS Development Environment(IDE): Eclipse, IntelliJ and Webstorm Web/Application Servers: Tomcat , WebLogic, Jetty, JBoss Mobile Technologies: Android RDBMS: Oracle, MySQL, MongoDB Platforms: Windows, UNIX, LINUX Testing Tools: Junit 4.x Version Control: SVN, GIT, CVS Methodologies: Agile Methodology, Scrum, Kanban Build Tools: Ant 1.7, Maven 2.x, Gradle ------------------------------------------------------------------------------------------------ I'm looking for challeging projects with strong believes in best practices to participate What you can expect from me: * Quality work (heavy testing, best practices, readable and maintainable code) * Short response time (actually I'd even prefer daily conference calls via skype) * Good speaking English * Responsibility for tasks/project I work on. * Seamless integration with your current team What would I expect from you: * Clear task definition * Easy communication * Adequate and in-time payment Keywords: JAVA, J2EE, Concurrent Programming, Spring, Cloud, Web-crawler,AWS (S3/SES/EC2/RDS/SQS), SOAP, REST, Apache SOLR, JAXB, MySQL Payment Terms : 20% released after First Milestone Delivery 30% released after Second Milestone Delivery 30% released after Third Milestone Delivery 20% released after Final Delivery

    $20.00 /hr
    340 hours
    5.00
  8. Alexander Savenko

    Alexander Savenko

    Professional data miner, extractor, IT expert, scrapper

    Latvia - Last active: 1 day ago - Tests: 8 - Portfolio: 1

    Dear Client, I am professional data miner and software developer providing web scraping services and data crawling using Python and specialized scraping frameworks. With over than 10 years of experience I have developed a wide range of back-end applications to scrape and extract desirable information from such sources as: online ticket systems, bets and gambling sites, business listings, real-time data (i.e forex and similar) and other related data sources. In most cases all data scraping projects are similar to each other and desirable output formats are CSV (Excel), PDF files or should be loaded directly to the databases (MySQL/MSSQL). Also may develop any type of client/server applications for Desktop (Windows 7/ Windows 8.1) and Unix-kind systems (Ubuntu, Debian). I would appreciate an opportunity to help you in resolving your particular issue and provide an outstanding results and requirements to your current deadline. Please do not hesitate to contact if you have any available projects. Thank you!

    $20.00 /hr
    12 hours
    4.92
  9. Alexander C.

    Alexander C.

    Scala / Java / Haskell developer, Full Stack Engineer, Consultant

    Russia - Last active: 5 days ago - Tests: 2 - Portfolio: 2

    Java developer with 8 years of experience. Now also Groovy(2 years) and Scala(1.5 years) developer. Java: Hadoop, Nutch , Lucene/SOLR/ElasticSearch, Morphia(MongoDB ORM), parsers/crawlers(using Apache Httpclient, HtmlUnit and own microframework), Web MVC(Struts 1.x/Grails), Java Desktop Applicatins(Swing) / Applets, webservices (w. Restlet framework), RabbitMQ Java client, Riak Java Client Scala: PlayFramework 2.x, Lift, Akka, ReactiveMongo Groovy: Groovy scripts / Gant build scripts / Gradle Databases: SQL(PostgreSQL/MySQL), MongoDB, Riak, SOLR/ElasticSearch PHP scripts, linux(fedora/centos/ubuntu) server administration, SVN / Git, SEO methods/scripts, affiliate marketing. Check my blog(chepurnoy.org)/GitHub(kushti) also.

    $60.00 /hr
    1,026 hours
    4.99