Upwork home
Sign up
Secondary

Hire the best Web Scrapers

Check out Web Scrapers with the skills you need for your next job.
Hire freelancers
Clients rate Web Scrapers
Rating is 4.8 out of 5.
4.8/5
based on 49,646 client reviews
  • $25 hourly

    • 5.0/5
    • (368 jobs)
    I have worked for many respected clients doing VA jobs for marketing, sales, recruitment, IT and real estate. My expertise includes research, data entry/data mining, lead generation, and LinkedIn list building for many years. I can understand and follow instructions very well and handle large quantity of work. I'm proficient in MS office products especially Microsoft Excel, Google documents/spreadsheets and have access to data scraping/email search tools. I've used HubSpot, Asana, Salesforce, Confluence/Atlassian, Jira, Atlassian, Top Producer, Mailchimp, Microsoft Teams, Dynamics and Constant Contact. I am always open to learning new tools if there are different ones you prefer to work with. I can take on new work immediately and look forward to speaking with you about your needs.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    AI Content Detection
    Data Collection
    Data Analytics
    Atlassian Confluence
    Salesforce
    Data Extraction
    Contact List
    LinkedIn
    HubSpot
    Lead Generation
    Microsoft Excel
    List Building
    Data Entry
    Data Scraping
    Data Mining
  • $45 hourly

    • 5.0/5
    • (47 jobs)
    Full-stack developer, system analyst and partner at CEI Tecnologia. Specialized in web and hybrid application development with Node.js as back-end, single-page applications with Angular for front-end and MongoDB as database. Knowledge in Data Mining / Web Scraping / Web Crawler. Graduated in Computer Science from FEI University and also graduated in Marketing from ESPM college.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Front-End Development
    HTML5
    ETL
    MongoDB
    API Development
    Node.js
    React
    Web Crawling
    CSS 3
    JavaScript
    Data Extraction
    Angular
    Data Mining
    Data Scraping
  • $38 hourly

    • 4.9/5
    • (26 jobs)
    Hi! I'm a full stack developer and specialize in Laravel & Vue for web app development and also Python + Selenium (or Playwright) for web automation. I can also work with other frameworks and develop web apps, websites, APIs and integrations. I am reliable, easy to communicate and willing to get things done. Also, I'm open-minded and always ready to learn more. No matter how big or small your project is, it will get my full attention and I will treat it with full responsibility. My Skills: I regularly use Laravel, VueJS, JavaScript, PHP and Python in my work. I have a lot of experience using Python + Selenium\Playwright for web automation. And I'm also very familiar with WordPress and can add custom plugins, integrations, etc there. I have experience as a server administrator, both Linux and FreeBSD. I feel comfortable in the terminal and can help with setting up servers and networks. For web development, I prefer using Laravel for the backend and Vue.js for the frontend. If you need to create a web app, or integrate some other service, or setup a script to automate some 3rd party app (or scrap\crawl a website) - I'm your guy. I also used and familiar with the following: Java, C#, C++, Python, SSH, FTP, Apache HTTP Server, MySQL, OAuth, API Development, Eclipse IDE, Visual Studio IDE, Trello, JumpLead, Zoho CRM, MailChimp, Slack, PhantomJS, WHMCS, WP Multisite Network, Chrome Extension Development, Amazon Web Services, Angular, jQuery, HTML, CSS, Bootstrap, SQL, XML, JSON.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Data Scraping
    PHP
    CSS
    JavaScript
    Laravel
    WordPress Plugin
    SQL
    HTML
    WordPress
  • $30 hourly

    • 5.0/5
    • (8 jobs)
    4+ years in data projects. I can help boost your business by getting and processing the data you need, when you need it. I'll bring you clever, creative, fresh and simple solutions for your needs. Enthusiastic, liable and self-demanding. Web scraping expert. End-to-end data solutions.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Machine Learning
    Data Science
    Data Analysis
    Data Scraping
    Python
    Data Engineering
  • $62 hourly

    • 5.0/5
    • (82 jobs)
    Taking care of the most complex and ambiguous data extraction/transformation projects. Extracting ANY type of data from ANY types of sources on a large scale. Solving "technically impossible" scraping tasks. My work experience includes: • Dealing with extreme volumes of data (10+ bil entries) and building high-performance crawlers (up to 500k entries per min); • Scraping data from hundreds of websites and services including Google Search & Maps, Bing, Instagram, Twitter, Facebook, LinkedIn, Pinterest, YouTube, Amazon, Ebay, AliExpress, Yelp, TripAdvisor, and others; • Dealing with all kinds of scraping restrictions and limitations (CAPTCHAs, authorization tokens and cookies, querying limits, browser fingerprinting, etc.); • Blending dozens of discrepant external data sources into one data flow, integrating with existing internal databases/systems; • Mining for "hidden" market/competitor data often transforming into actionable insights; • Visualizing insights from external data in "easy to read" diagrams, reports, and maps. -------------------------------------- Technical background/preferences: • Programming Languages: C# - Primary, Python, JavaScript - Secondary • Platforms: Windows - Primary, Linux, MacOS - Secondary • Databases: PostgreSQL, SQL Server, MySQL, Amazon Athena/S3, Google BigQuery • Cloud Platforms: AWS, Google Cloud, Microsoft Azure • BI Reporting Tools: Tableau, Redash, Retool, Apache Superset
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    C#
    SQL
    Browser Automation
    PostgreSQL Programming
    API Integration
    Data Scraping
    Web Crawling
    Data Extraction
    Data Mining
    Selenium
  • $60 hourly

    • 5.0/5
    • (13 jobs)
    I am Snowflake Certified Data Engineer with 7+ years of experience in ETL, BI, and DWH. Currently working as Lead on multiple projects. Having excellent analytical & design skills, a focused approach, a professional attitude to work, and working at the eastern standard time will make me the perfect candidate that you are looking for! PROFILE:- • Hand-on experience on Pentaho Data Integration, SSIS, Informatica • Exposure to large data volumes in major database systems like Postgres, Redshift • Deep knowledge of SQL, and Reporting experience in Tableau, Power BI • Experience in DWH with substantial knowledge of Finance and Retail domains • Experience in working Agile Environments like JIRA, Trello • Working knowledge of complete Data warehouse development life cycle SKILL SUMMARY:- Data Integration Tools & Technologies • Python :- 2.7, 3.6 • DBT • FiveTran • Pentaho Data Integration :- 5.0, 5.1, 5.2, 6.0, 6.1, 7.1 • SQL Server Integration Service (SSIS) • Informatica PowerCenter :- 9.6 BI/Reporting • Sigma • Looker • Tableau • Microsoft Power BI • Pentaho Reports Databases • Snowflake - SnowPro Core Certified • PostgreSQL :- 9.3, 9.5 • Oracle • Amazon Redshift • Google Big Query • IBM Netezza • Microsoft SQL Server • MySQL Looking forward to working with you!
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Microsoft SQL Server Programming
    Data Warehousing
    Business Intelligence
    Pentaho
    Tableau
    Microsoft Power BI
    Data Integration
    Data Migration
    Data Scraping
    Python
    ETL
    SQL Server Integration Services
    ETL Pipeline
    SQL
  • $29 hourly

    • 4.9/5
    • (58 jobs)
    Plasmo Framework Contributor 100% browser extension jobs on Upwork Empowering You to Optimize Purchases and Maximize Free Time while Enhancing Personal/Company Values Automate boring stuff ! Scrape for collecting the data ! Migrate your extension to manifest v3 ! Cleanup your messy extension code then scale up ! Linkedin, Amazon, Instagram, Facebook, Youtube, Google Docs etc I can build easy to use chrome extension for YOU! And please focus on what matter for your life :)
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Firefox Plugin Development
    Browser Extension
    Browser Automation
    React
    Google Chrome Extension
    Node.js
    Data Scraping
    Automation
  • $65 hourly

    • 5.0/5
    • (359 jobs)
    I am an expert web scraper with expertise in scraping: 1. Complex Websites with AJAX/JS Pagination 2. Websites hiding data behind authenticated pages 3. Websites that hide data behind search boxes. 4. Non-english websites including Chinese, Korean or European language websites. After getting the data, I put it in clean spreadsheet and deliver in any format including XML, XLS, CSV and JSON. Apart from creating data myself, I can also create code snippets for proprietary frameworks requiring custom JavaScript/XPath Selectors and RegEx transformations, including TacticalArbitrage.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Data Mining
    jQuery
    Data Entry
    Regex Writing
    JavaScript
    Python
    Data Extraction
    ETL
    Data Scraping
  • $25 hourly

    • 4.9/5
    • (80 jobs)
    With over a decade of experience in web scraping, I specialize in generating high-quality data sets from multiple sources, including websites, APIs, PDFs, and more. I also provide continuous data extraction and maintenance services, as well as design and development of data dashboards and APIs to help you manage and analyze your extracted data. I am highly experienced in extracting data from a range of platforms, including e-commerce websites and marketplaces such as Amazon, eBay, Walmart, Tmall, and Newegg; search engines like Google, Bing, and Duckduckgo; and social media platforms such as LinkedIn or Twitter. Additionally, I am proficient in extracting data from business, real estate, job, car listings, and directories, including Yelp, Zillow, Monster, and Cars.com. I can also extract data from delivery services such as Grubhub, DoorDash, and Uber Eats, as well as other aggregators and marketplaces like Airbnb, Airtasker, Uber, Lyft. I offer a wide range of data formats for your convenience, including Excel, CSV, JSON, MySQL, and Google Sheets. If you require a custom scraper for your specific needs, I can develop a web scraper for your personal use that you can easily operate with one click on your PC. My job history on Upwork showcases several long-term projects that lasted up to 5 years. This demonstrates my commitment to delivering high-quality results to my clients and building long-term relationships based on trust and satisfaction. Feel free to contact me at any time to discuss your data extraction needs. I guarantee fast and efficient service with the best possible quality of data.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Business Process Automation
    Business Applications Development
    Scripts & Utilities
    API
    Data Extraction
    ETL
    Google Sheets
    Microsoft Excel
    MySQL
    PHP
    SQL
    Beautiful Soup
    Scrapy
    Python
  • $100 hourly

    • 5.0/5
    • (672 jobs)
    LinkedIn scraping has become extremely difficult in the last few years – especially at Large Scale. Tools like Phantombuster can scrape hundreds of profiles a day – how can you scale it up to tens of thousands a day for your ambitious projects? You may already try services like proxycurl, but more often than not, their data is outdated (scraped months ago). Using Python, I built the "one of its kind" LinkedIn Scraper for large-volume LinkedIn scraping projects. The system allows me to: ✅ Scrape leads from LinkedIn Sales Navigator searches, including verified emails – Big search? No problem! ✅ Extract LinkedIn people profiles ✅ Extract LinkedIn company profiles ✅ Find decision makers of specific companies on LinkedIn, accurately and quickly ✅ Extract current employees of specific companies on LinkedIn ✅ Extract past employees of specific companies on LinkedIn ✅ Extract all member profiles of specific groups on LinkedIn ✅ Scrape LinkedIn job posts ✅ Find companies on LinkedIn based on a list of web domains or company names What makes my LinkedIn Scraping service different? 💯 Real-time information (up-to-date profiles, not cached data) 💯Large volumes of data — up to thousands and millions of profiles 💯 No need for access to your LinkedIn account or Sales Navigator 💯 Fast, accurate, and customized to your specific criteria People who have used my service once come back whenever they need more data: ⭐️⭐️⭐️⭐️⭐️ "Cung is professional and highly capable. He can do things that many others will say are impossible. Worth every penny. Stop scrolling, and start hiring!" – Mark ⭐️⭐️⭐️⭐️⭐️ "Cung is a master. Excellent skills, fantastic communicator, and an exceptionally talented engineer. If he can't do it, nobody can. Highly recommend!" – Spencer ⭐️⭐️⭐️⭐️⭐️ "Cung is just phenomenal! He is fast, reliable, and accurate and needs only to be pointed to a project and set to go. He thinks on his feet, asks just the right questions, and gets the job done. Just fantastic. Thank you, Cung!" – Peter Barry Ready to get started? Send me a message, and let's talk!
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    API
    LinkedIn Plugin
    List Building
    Social Media Lead Generation
    LinkedIn
    Data Mining
    Lead Generation
    JavaScript
    Web Crawling
    ETL
    Data Scraping
    Python
    Data Extraction
    SQL
  • $12 hourly

    • 5.0/5
    • (20 jobs)
    For the past 20 years, I have served as an examiner, researcher, and abstractor in various aspects of US Real Estate Title Insurance. My work has taken me across multiple states, including AZ, CA, OH, FL, SC, NC, NJ, NY, AL, TN, MS, OK, NV, MI, LA, MA, GA, MD, KY, IA, NM, and TX. As a Top Rated Plus Freelancer, I possess extensive knowledge and expertise in Real Estate Title Examination, encompassing Full Search, Current Owner Search, 2 Owner Search, Lien Search, Title search, Expedite search, Prop plus search, foreclosure sale, Real Estate Due Diligence, and Document Review. I have the expertise to thoroughly research, examine, and interpret various documents critical to Real Estate Title Insurance, including chain of title, Deeds, Mortgages, Deed of Trust, Liens, Judgment, HOA documents, Easements, Agreements, State Tax Liens, Taxes, Probates, Foreclosure documents, and Due Diligence Reports for Vacant Land. Highly Experienced in using/doing these: • Title Opinion Report • Loan Title Policy • Preliminary Title Report • Commitment Title Report • Netronline (County Website) • GIS Maps / Google Maps/ Utilities Maps • GPS coordinates • RealQuest • LexisNexis • Data Tree • Data Trace • Airtable • Yellow pages • Zillow/Redfin/Realtor • MS word & excel • Resware • LGPass • Slack • Trello • Pebble • Dropbox • Google drive
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Document Review
    Data Analysis
    Data Interpretation
    Real Estate IDX
    Real Estate Appraisal
    Property Tax
    Data Scraping
    Data Entry
    Due Diligence
    Online Research
    Report
  • $50 hourly

    • 5.0/5
    • (357 jobs)
    I have wide experience in developing, designing and managing projects with a variety of technologies. My preferred development languages are Perl, Go and Python; also, I'm proficient in Java, Javascript/AJAX, jQuery, full-stack web development and SQL. Ones of the most effective my skill are: automating of routine tasks; creating some scripts and utilities; creating desktop application; boundary problems: cross-technology, cross-language, reverse engineering, etc. I met with the computer for more than 20 years ago and since then my work is closely related to programming. Most of this time I was working alone, so I implemented the full cycle of software development in the projects I've worked on. I am a fast learner and problem solving oriented programmer. My priorities are quality and client satisfaction.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Perl
    Scripts & Utilities
    Database Management
    Java
    Golang
    Scripting
    Data Scraping
    Microsoft Power BI
    SQL
    Python
    Data Entry
  • $50 hourly

    • 5.0/5
    • (14 jobs)
    Industrial Engineer with experience in Business Intelligence projects. Clear indicators of analytical capacity, proactivity, and results orientation with a data-driven approach. I have proficiency in Tableau, Qlik Sense, Power BI, Data Studio, BigQuery, MySQL, Python, and R. Willing to learn new technologies and take new challenges. In charge of many BI projects such as building DWH, forecasting models, data cleansing, Data Governance and Web Scraping
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Financial Analysis
    Data Analysis
    BigQuery
    Data Modeling
    Data Cleaning
    Data Scraping
    LookML
    Data Science
    Optimization Modeling
    Looker
    Data Visualization
    Tableau
    Looker Studio
    SQL
    Qlik Sense
  • $18 hourly

    • 5.0/5
    • (10 jobs)
    Working area:- • Responsive Web Development (Symfony, Laravel and other PHP Framework) and also have knowledge of Wordpress • Data mining with the help of Python, Perl, PHP, Javascript • Experience in Selenium and Headless Browsers (Phantomjs, Chromium and Puppeteer etc) • Data management with Mysql, Postgres and MongoDB • Any script development in Python, Perl and PHP I have experience to develop different types of websites like eCommerce, Blogs and Personal, Informational etc. I also have experience to create an admin panel through any php framework like Laravel, Symfony and CodeIgnitor Experience:- • 6+ year Core PHP (2012 to present) experience and 3+ year PHP framework (Laravel, Symfony, Codeigniter and Slim) experience in web development. • 2+ year (2017 to present) experience with Perl and 1+ year (2018 to present) experience with Python in scraping and data management. I parsed/collect data from different sites like eCommerce, Social and property etc, also created scripts in Python or Perl for different cases. • Handling big data in front-end and server side. • Installation and configuration of sphinxSearch and use in PHP and Laravel 5+. • 2+ year experience of git (Github, Gitlab and Bitbucket). • 1+ year experience of deployer for deployment, also capable to deploy application with the help of CI/CD. • Experience of redis cache to store data in memory with Python, Perl, PHP and Laravel. • Familiar with jira and asana • I also have experience of Docker. • Worked on Perl and Python to create scripts for scraping XML, CSV, web scraping and web crawling using regular expressions and Beautiful Soup. • A team player with analytical, relationship management & leadership skills. Ability to work under pressure and meet deadlines. Skills:- • Languages : PHP, Python, Perl • Frameworks : Laravel 5+, Symfony, CodeIgniter and Slim • Scripting Languages : JavaScript, jQuery • Technology : HTML, HTML5, CSS, Bootstrap 3 and Bootstrap 4 • Data Structure : Json, Hash etc. • Databases : MySQL, Postgres, MongoDB • Search Engine : Sphinxsearch Working Experience:- • Website: airdna (Data analytic site) Technology: Symfony Framework 2.7, Postgres. Role: Web development(Symfony) and Data Management I also create Investment Explorer app in angular 1.6 with the help of D3.js and Google Map for Airdna
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    MongoDB
    Web Crawling
    Symfony
    Perl
    Node.js
    Laravel
    PHP
    Web Development
    Data Scraping
    Python
  • $30 hourly

    • 4.4/5
    • (125 jobs)
    Learning is also a kind of earning. So, I learned Web analytics and completed 200+ projects on Fiverr and Upwork. Then I fell in love with Data Science and learned its all topics by heart along with a master degree in Data Science :) The future belongs to those who learn more and more skills so I believe that when we stop learning, we start dying. However, my existing skills along with a short description are given below. Web Analytics: Certified, experienced and best at web analytics using Matomo and Google Analytics. Web Development: PHP frameworks are my home turf and I have completed so many projects in Opencart, Codeigniter, Laravel, and WordPress. Please have a look at the portfolio to see the projects. Web scraping & crawling: Thanks to the Search Engine development project for which I crawled & scraped 1 million web documents :P so after that I always see myself doing scraping, crawling, and automation-related projects. For automation, I use selenium, beautiful soup, and Python. APIs development: As Python is in my blood so before data science, I used to work on APIs development and web scraping using Python. Big data: I have rich experience in the Hadoop eco-system using Apache Hadoop, Apache Hbase, Apache Nutch, Apache Hive, Apache Solr, etc. The detail is given below. ** Apache Hbase: How to store and retrieve data from Hbase and how to use it with Hadoop and Apache Nutch. ** Apache Nutch: How do search engines work? How to develop your own search engine using Apache Nutch as a crawler, Customization of Nutch at all phases, Tuning of Nutch for effective crawl, and a lot more. ** Apache Solr: How to use Solr for indexing purposes, How to use it in distributed mode, how to do indexing, how to analyze indexed data using different Solr clients. Matomo analytics: There was a time when I was the only Matomo related developer on Fiverr and Upwork. I have very rich experience in following tasks. ** Matomo Installation, configuration, and integration with the website. ** Matomo customization like custom dashboard development i.e., change look & feel different and you can claim that it is your custom product. ** Custom event tracking with/without Matomo tag manager ** Custom variables/dimensions, Goals, and conversions tracking. ** Conversion rate, custom reporting, and GeoIP-based correct location tracking. ** Expert to fetch tracking data through Matomo API to develop a custom dashboard or to display insights on another website.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    RESTful API
    Machine Learning
    Data Analysis
    Google Analytics
    Database Design
    Web Analytics
    Big Data
    MySQL
    DApps
    Piwik PRO
    ETL Pipeline
    Python
    Microsoft Excel
    Data Scraping
    Data Mining
  • $50 hourly

    • 5.0/5
    • (3 jobs)
    Hi, I'm a data scientist with a strong background in collecting and analyzing data to help organizations make informed decisions based on trend analysis, predictive modeling, and data visualization. My expertise includes maintaining and designing machine learning models that correlate with business needs alongside developing and implementing SQL and Python code to clean, transform, investigate, and augment large, complex database tables. As a data scientist, I have extensive experience designing rich data visualizations to communicate complex ideas to company leaders. I support and consult with businesses to propagate data management best practices and investigate the impact of new technologies. My skills also include ensuring data and intent integrity by automated data quality verification pipelines, developing and applying machine learning models and algorithms, and supporting team members. I have worked closely with businesses to identify issues and use data to propose solutions for effective decision-making. I build algorithms and design experiments to merge, manage, interrogate, and extract data to supply tailored reports to colleagues, customers, or the wider organization. I use machine learning tools and statistical techniques to produce solutions to problems. Furthermore, I have a proven track record of creating clear reports and dashboards that tell compelling stories about how customers or clients work with the business. I conduct research from which prototypes and proof of concepts develop alongside looking for opportunities to use insights/datasets/code/models across functions in the organization. I plan and designate project resources, monitor progress, and keep stakeholders informed the entire way while team-leading and mentoring new joiners on best practices in data science. In summary, my skills include problem-solving, data science, data analytics, data visualization, machine learning , artificial intelligence (AI), statistics, forecasting, databases, statistical data analysis, data modeling, SQL, team workshops, project management, agile methodologies, analytical skills, Python (Programming Language), Microsoft Excel, Microsoft Power BI and and banking,
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Forecasting
    Data Analysis
    Data Cleaning
    Statistical Analysis
    Data Scraping
    Data Science
    Data Visualization
    Microsoft Excel
    Python
    Machine Learning
    Dashboard
    SQL
  • $20 hourly

    • 5.0/5
    • (57 jobs)
    Hello, Thank you for being interested in my profile. 🙂 My name is Anton and I am a self-taught Python Automation Engineer 🐍 Coding Experience ~5 years Features: - Automation - TG Bots - Scraping / Parsing / Crawling - Desktop GUI for Windows/OSX (PyQt5(PySide2)) - Manipulating w/ files/tables/sheets - And any what you need! Just chat me 👌 Best regards, Anton
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Python-Requests
    PyQt
    Desktop Application
    Python Script
    API
    JSON
    Scripting
    Automation
    Selenium
    Beautiful Soup
    Web Crawling
    Data Scraping
    Python
    Data Extraction
  • $78 hourly

    • 4.8/5
    • (56 jobs)
    I am an experienced data scientist who has worked in Bioinformatics and Business analytics. I build automated trading strategies in my spare time. I've been programming in R daily for over 15 years and that's where I do most of my data analysis. I have a lot of experience with machine learning and data visualizations, mainly in R and Shiny. Working in a diverse set of fields has given me experience with many different types of data and obtaining it from many different sources. Thereby making me an excellent data miner, and knowing how to transform that data efficiently.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Data Analysis
    R Shiny
    API
    Forex Trading
    Statistics
    Analytics
    Bioinformatics
    Quantitative Analysis
    Data Scraping
    Plotly
    Machine Learning
    Data Visualization
    R
    Data Science
  • $30 hourly

    • 4.9/5
    • (36 jobs)
    I'm a data scientist with 5+ years of hands-on experience in machine learning and a strong math background (MSc. in Applied Mathematics). I can help you to build the whole ML pipeline from scratch or improve your solutions. Dealing with various tasks, such as NLP, Time Series Analysis, Computer Vision, GANs, developing bots for Stocks or/and Crypto markets, deploying APIs for ML models, etc. Skills: - Languages: Python - Frameworks: PyTorch, TensorFlow, Keras, Flask - Libraries: LangChain, NumPy, Pandas, Scikit-Learn, Matplotlib, Plotly, SciPy, NLTK, LightGBM, XGBoost - DB: MySQL, PostgreSQL, MongoDB - Version control: GIT - Other: Docker, Google Cloud, LLM, ChatGPT, LLaMA
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Data Scraping
    Web Crawling
    ChatGPT
    Neural Network
    SQL
    Statistics
    Machine Learning
    NLTK
    Python Scikit-Learn
    Deep Learning
    Data Science Consultation
    Python
    TensorFlow
    Natural Language Processing
    Keras
  • $50 hourly

    • 4.7/5
    • (219 jobs)
    Grow your business by feeding it high-quality leads! Google Maps is widely regarded as the top source of leads, with billions of places data for all business categories. If you want to take advantage of this, you've come to the right place! I'm here to help you get the leads that fit your needs. My spiders are ready to go, so just contact me to start collecting leads. Together, we'll make sure your business reaches its full potential
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Selenium
    Data Mining
    Web Crawling
    Lead Generation
    Object-Oriented Programming
    Data Scraping
    Google Maps API
    API Development
    Laravel
    PHP
  • $70 hourly

    • 4.9/5
    • (33 jobs)
    🌐 Welcome to my profile! If you're looking to unlock the power of web scraping and crawling for your business, you've come to the right place. I specialize in creating efficient, data-driven solutions that can save you time and provide you with valuable insights. 🌟 Why Choose Me for Web Scraping and Crawling: ✅ Automation Efficiency: Web scrapers are your ticket to automating tedious data collection tasks. This translates to significant time savings, allowing you and your team to focus on more strategic activities. With my expertise, you can collect data at volumes that would be impossible for a single human to achieve. 🤖 Sophisticated Web Bots: I have a strong background in creating advanced web bots to automate a wide range of online activities. Leveraging programming languages like Python, I can design bots that streamline your online operations, whether it's tracking prices, monitoring real estate listings, or gathering data for your e-commerce venture. 🏆 Experience and Expertise: With a wealth of experience, I've designed, developed, and deployed numerous web scrapers across various industries, including real estate, price comparison, product hunting, e-commerce, and financial markets (crypto/stocks). I specialize in crafting robust Python web scrapers tailored to your specific website, delivering structured, up-to-date data. 🌐 Deployment Flexibility: I offer the flexibility of running web scrapers on your local system or deploying them on servers/cloud infrastructure for continuous data feeds. Simply tell me your data requirements, and I'll handle the rest. 🚀 Professional Background: As the 2nd Engineer at Crawlnow.com, I played a pivotal role in designing and implementing high-performance web crawlers and scrapers, gaining valuable experience in the field. 🛠️ Tools I Excel In: Python Scrapy Selenium HTML Headless browsers AWS Lambda AWS Elastic Container Service (ECS) AWS S3 CSV/Excel/JSON/XML/Google Sheets/MySQL/MongoDB databases REST APIs Django Rest Framework Postgres 🔍 How to Get Started: When reaching out, please provide me with the following details: - Websites you want to scrape data from - Fields/columns you are looking for Guaranteed: You can count on me for 100% quality work, flexible timing, and reasonable costs. I'm dedicated to delivering exceptional results tailored to your unique needs. Ready to embark on a data-driven journey? Let's collaborate and turn your web scraping and crawling needs into actionable insights. Feel free to customize and expand upon this profile description to highlight any additional skills or experiences that set you apart in the field of web scraping and crawling.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Automation
    Web Crawling
    html2text
    ETL
    Data Scraping
    Selenium
    Python
    Data Mining
    Data Extraction
  • $12 hourly

    • 5.0/5
    • (62 jobs)
    I specialise in lead generation, virtual assistance, team management & training, contact lists, database management, admin support for mortgage brokers and financial consultants, project management & real estate lead generation. I'm passionate about helping businesses and organizations in Australia succeed. I understand the importance of accuracy and reliability when it comes to business decisions that's why I use the latest technology to ensure that my resources are up-to-date and reliable. By leveraging accurate records, I help companies save time and money while gaining a competitive edge in their respective industries. I also have experience in writing financial & personal investment reports, professional emails for different purposes (business correspondence or marketing) and creating social media ads, blogs, posts & content for social media marketing. Under my belt is 20 years of combined freelancing & corprate experience working with world-renown brands such HSBC, Time Warner Cable, Earthlink, Sprint, LJ Hooker, Century21 and Ray White. In the last 11 years, I focused on database creation, lead generation, virtual assistance and database management. I'm able to build and manage marketing databases/contact lists for businesses in Australia. From 2013-2015 I was initially hired to do the database of Core Real Estate & Keith English Real Estate, but the role expanded to full virtual assistance. From 2015 & till current my team & I manage 2 franchises of LJ Hooker's databases in Western Australia. From time to time is also in charge of creating reports & conducting competitor analysis. At one time I supported not only their sales team but also their property management team as needed. I also managed the database of one franchise of LJ Hooker (residential) in NSW and one commercial in QLD around 2018. From 2023- current, I'm on an on-going project with 2 franchises of Ray White updating their contact databases for lead generation generating absentee owner leads & owners of commercial properties. I was also a Property Investment & Mortgage Support Specialist for the National Wealth Advisory & Allied Mortgage Corporation in Gold Coast from 2021-2023 where I offered back-office support for these businesses creating reports such Personal Investment Analysis, Mortgage Reduction & Projected Investment Outcomes, Current Market Analyis among some & followed up/ liaised with clients on loan requirements, agents & financial planners. In 2023, I was hired by Exteria & Modus to do their research & phone lead generation project to councils all across Australia. From 2018 - 2023 I updated the database of Alfa Financial Solutions giving them leads of homeowners as well as business owners who may qualify for loans. These are just some of the clients, there are more in between that wouldn't fit in the description. Please check my profile for the other clients and experience where I was engaged in numerous reearch & database projects exclusively for Australian clients. I also have a basic knowledge and overview of marketing, advertising, sales & customer service. Australian Clients include: The Ideas Bodega Core Real Estate The Loan Hound/Prospa Property Investment Advisors Smart Digital Australia Keith English and Associates Tank Scott Penning LJ Hooker Twin Waters Business Profits Group West Side Denture Center CFO Dynamics David Desmond LJ Hooker Perth City Residential LJ Hooker Mandurah LJ Hooker Claremont, now Ray White Dalkeith Claremont Enlight-On Electrical Solutions: Bayliss Electrical Group BDM Digital Marketing: MyPad Property Styling Greenwood Solutions National Wealth Advisory Allied Mortgage Corporation Business Profits Group (rebranded - Broker Ideas Group) Exteria Modus I also have 9 years experience in the Business Processing Industry. Below are my career highlights: CREDIT CORP: Collections Team Performance Manager 1) I helped pioneer an Au call center operations in the Philippines in October 2010 and helped grow the 25 staff to close to 300 in 3 years and the revenue from $30,000 to $2,000,000 per month. 2) Mentored 14 agents through Leadership and Motivational Training and they were promoted to Senior Customer Relationship Associates and Team Performance Managers 3) Awarded Star Employee in December 2010 4) Five Team of the Month awards for the teams I manage HSBC 1) Rose from the ranks as an agent then to a Performance Coach and finally to Assistant Manager for Operations (2007-2010) 2) Numerous Dream Team Awards for M1 and M2 sites for my teams 3) Successfully run the Skills Qualifications Training for two sites of over 1,000 staff which decreased roll rates by 50% resulting in more revenue for the company and increase Customer satisfaction from 69% to 82% for two sites combined. I graduated from a top ranking university in the Philippines (University of the Philippines) with a degree in Bachelor of Arts in Communication Arts & master's units in Speech Communication.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    English
    Finance & Accounting
    Lead Generation
    Administrative Support
    Sales
    List Building
    Data Scraping
    Customer Service
    Call Center Management
    Data Mining
    Microsoft Excel
    Real Estate
    Data Entry
  • $100 hourly

    • 5.0/5
    • (510 jobs)
    2-3 hours for creating a scraping script for the average website. More than 1000+ scripts made in the last 10 years Shopify into Google Sheet automation with Java
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Google APIs
    API
    IMacros
    LinkedIn
    Java
    MySQL Programming
    LinkedIn Development
    Lead Generation
    Web Crawling
    Selenium WebDriver
    Selenium
    Data Scraping
    ETL Pipeline
  • $25 hourly

    • 5.0/5
    • (106 jobs)
    Finding the perfect freelancer for your project might seem daunting, but I’m here to make it easy. With a zeal for conquering challenging tasks and a constant quest for innovation, I guarantee results and excellence. Offered Services: Lead Generation: Transforming prospects into potential leads to fuel your business growth. Virtual Assistance: Managing your tasks efficiently to maximize your productivity. Web Research: Delivering accurate insights to inform your decisions. Data Mastery: Expert handling of data entry, cleaning, sorting, and collection for streamlined operations. Review Management: Elevating your brand’s reputation across Yelp, G2, FinancesOnline, TrustRadius, TrustPilot, Google My Business, Angie’s List, and beyond. Comprehensive Technical Proficiency: My technical toolkit is robust, encompassing WordPress, Shopify, MailChimp, Elementor, Google Suite (Docs, Sheets, Slides), Zoho CRM, Email Automation strategies, compelling Landing page creation, and customer service via Zendesk. Proficient in MS Office for all your documentation needs, LinkedIn Sales Navigator for pinpoint lead generation, RocketReach and Hunter for effective outreach, and an in-depth understanding of SMTP/SPF/DMARC/DKIM for your email marketing needs. Why Partner with Me? I seek lasting partnerships, not just transactions. I believe in understanding your goals deeply and aligning my skills to meet and exceed your expectations. My commitment is to clarity and excellence; I take on projects only when I’m confident in delivering top-tier results, ensuring we’re on the same page. Your success is my priority, and I’m eager to be part of your journey. If you’re searching for a dedicated, skilled professional who’s ready from day one to contribute to your project's success, let’s discuss how we can work together.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Web Design
    Email Deliverability
    WordPress
    Ecommerce Website
    Data Scraping
    Prospect List
    B2B Marketing
    Review
    Customer Support Plugin
    Lead Generation
    List Building
    Data Entry
  • $38 hourly

    • 4.9/5
    • (621 jobs)
    Hi I am a professional designer and I have eighteen year veteran instructor in all things computer graphics and Adobe Photoshop and Illustrator automation solutions (Javascript/CEP/UXP). here are few skills that may be relevant to what your job require and in which am really good: ➡ Automation Scripts/Actions for Photoshop, illustrator and Indesign ➡ Stitching & retouching (360°) panoramic videos and images. ➡ Real estate photo retouching & editing. ➡ Portrait retouching. ➡ Photo Enhancement. ➡ Photo manipulation. ➡ Clipping path. ➡ Background Removal. ➡ Photo resize. ➡ Photos batch processing. ➡ Photo Optimization for the web or print. ➡ Adobe After Effects templates customization ➡ Web data Scraping. If you are reading this, i am sure you are about to successfully select the best fit to your job.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    PSD
    RAW
    Adobe Illustrator
    Photo Retouching
    System Automation
    Panoramic Stitching
    Adobe Photoshop
    Adobe Acrobat
    Automated Workflow
    Photo Editing
    Scripting
    Automation
    Data Scraping
    JavaScript
  • $25 hourly

    • 4.7/5
    • (147 jobs)
    Hi, I am Zainab, with over 8 years of experience in Web development and digital marketing field. I help you to build your online presence, starting from web development to marketing. I am an expert in WordPress | Learndash | WooCommerce | Plugins Customisation | Graphic design | Social Media | Ecommerce Guru | Marketing | Facebook Ads and PPC. Not only that, but I often help small and mid-size companies grow their business online, but that doesn't restrict me from working with large companies as well. They include complex projects covering a wide spectrum of objectives. Each of those experiences improves my ability to help your business achieve the results you want. Beyond website development, I offer comprehensive marketing solutions. That includes Social Media Marketing, Graphic design, UX/UI Solutions, PPC, Facebook Ads, and TikTok ads. I use Clickup for task management and Slack for communication to ensure my clients with the daily updates and progress on their projects. Also, My profile is associated with a company where we offer complete full-stack solutions from Low fidelity wireframes to marketing solutions.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Membership Plugin
    Learning Management System
    SEO Writing
    Graphic Design
    Web Application
    Ecommerce Website Development
    Payment Gateway Integration
    Theme Customization
    PHP
    LearnDash
    WordPress
    Elementor
    WooCommerce
  • $25 hourly

    • 5.0/5
    • (242 jobs)
    I have been in the software field for 12 years. I have the expertise in understanding the structure of the websites from which data needs to be scraped, as I am also a web designer. This helps me in precisely locating the markup codes that contain the required data. I can scrape data from almost any web source, static or dynamic. I also make use of Regular Expressions to precisely distinguish required data. The rate at which data can be extracted depends on the website. Data can be extracted from a static website at less than a second a page to about 4 seconds a page, depending on how fast a website serves a request. But some times the rate has to be reduced to avoid being blocked from accessig the website. Dynamic / Javascript / Ajax based websites take longer to scrape, as the content is updated in real-time. It may take 6 to 15 seconds to scrape a page from a static website, again depending to the time it takes for the page to get updated. If the website from which data needs to be extracted has a bad structure, then it is made necessary to process the data after extraction. I have a sound knowledge of Excel, and this too helps me in processing and cleaning up the extracted data. Another good tool that allows me to use Regular Expressions for processing and cleaning up extracted data is Notepad++. I can provide the scraped data is various formats like - CSV, Excel, Text, HTML, JASON, XML & SQL. I take my job seriously and see to it that the job is completed in the shortest time and well before dead line and is error free. This has helped me build long-term relations with my clients.
    vsuc_fltilesrefresh_TrophyIcon Web Scraping
    Data Entry
    Data Mining
    Microsoft Excel
    Web Crawling
    Data Extraction
    ETL
    Data Scraping
  • Want to browse more freelancers?
    Sign up

How it works

1. Post a job

Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.

2. Talent comes to you

Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.

3. Collaborate easily

Use Upwork to chat or video call, share files, and track project progress right from the app.

4. Payment simplified

Receive invoices and make payments through Upwork. Only pay for work you authorize.

Trusted by

Web Scraper Developer Hiring FAQs

What is web scraping?

Web scraping is the practice of extracting raw data from a website via automated tools such as ScrapingBee, Screaming Frog, and Scrapy. Instead of manually visiting web pages to copy and paste information into a spreadsheet, web scrapers automatically pull this information en masse by crawling the web. You can use web scraping for market research, sentiment analysis, content monitoring, and more. 

The data can be the following:

  • product items;
  • images;
  • videos;
  • text;
  • contact information, e.g. emails, phone numbers etc.

How do you hire a web scraper developer?

You can source web scraping talent on Upwork by following these three steps:

  • Write a project description. You’ll want to determine your scope of work and the skills and requirements you are looking for in web scrapers.
  • Post it on Upwork. Once you’ve written a project description, post it to Upwork. Simply follow the prompts to help you input the information you collected to scope out your project.
  • Shortlist and interview web scrapers. Once the proposals start coming in, create a shortlist of the professionals you want to interview. 

Of these three steps, your project description is where you will determine your scope of work and the specific type of web scraper you need to complete your project.

How much does it cost to hire a web scraper developer?

Rates can vary due to many factors, including expertise and experience, location, and market conditions.

  • An experienced web scraper may command higher fees but also work faster, have more-specialized areas of expertise, and deliver higher-quality work.
  • A contractor who is still in the process of building a client base may price their web scraping services more competitively. 

Rates typically charged by web scrapers on Upwork are:

  • Beginner: $12 per hour
  • Intermediate: $42 per hour
  • Advanced: $135 per hour

Which one is right for you will depend on the specifics of your project. 

How do you write a web scraper developer job post?

Your job post is your chance to describe your project scope, budget, and talent needs. Although you don’t need a full job description as you would when hiring an employee, aim to provide enough detail for a contractor to know if they’re the right fit for the project.

Job post title

Create a simple title that describes exactly what you’re looking for. The idea is to target the keywords that your ideal candidate is likely to type into a job search bar to find your project. Here are some sample web scraper job post titles:

  • Web scraper needed to assist with market research and sentiment analysis
  • Seeking a data analyst experienced with web scraping
  • Need help building a real estate website scraper and crawler

Project description

An effective web scraping job post should include: 

  • Scope of work: From CSV files to SQL database tables, list all the deliverables you’ll need. 
  • Project length: Your job post should indicate whether this is a smaller or larger project. 
  • Background: If you prefer experience with certain industries, web scraping tools, or automation technologies, mention this here. 
  • Budget: Set a budget and note your preference for hourly rates vs. fixed-price contracts.

Web scraper job responsibilities

Here are some examples of web scraper job responsibilities:

  • Utilize web scraping tools to pull unstructured data from websites
  • Process data into desired formats and schemata to allow for complex SQL queries
  • Write custom scripts to assist with web scraping and subsequent data processing

Web scraper job requirements and qualifications

Be sure to include any requirements and qualifications you’re looking for in a web scraper. Here are some examples:

  • Web scraping and crawling
  • Data analysis
  • Web scraping tools (e.g., Import.io, PySpider, ScrapingHub) 
  • Scripting language (e.g., Python, JavaScript) 

Are there any challenges I may want to know?

Yes, there are. After having some extensive web scraping experience, we’ve outlined a list of things that can prevent you from taking full advantage of web scrapers.

  • Most of the websites are simply different layout-wise.
  • Amateurs or pros, not all web developers follow style guides. As a result, their code often contains various mistakes making it absolutely unreadable for scrapers.
  • Many websites are built with HTML5 in which any element can be unique.

Content copy protection, e.g. a multi-level layout, using JavaScript for content rendering, user-agent validations etc.

  • Depending on either the season of the year or the subject of the content itself, some websites can change their layouts. Keeping up with these changes requires a lot of time and effort.
  • The abundance of ads, floods of comments, too many navigation elements, etc.
  • In the web page code, there can be links to the same images of different size, e.g. image preview.
  • Since the choice of language on most of the websites is based on your location, the content may not always be displayed in English.
  • Websites can have their own encoding that is impossible to send back with a request.

All these factors directly affect the quality of the content leading to its decrease by unacceptable 10% or even 20%. But I’m dying to scrape some websites! What should I do?

Basically, it all boils down to the following options:

  • If the number of websites you’re going to scrape the data from is quite small, it’s better to write your own scraper and customize it according to each specific website. The quality of the output content should be 100%.
  • If the number of websites to scrape goes beyond “small”, we suggest using a complex approach. In this case, the output content quality should be close to 95%.
Read more
View less

Web Scraper Hiring Resources

Learn about cost factors Hire talent
Schedule a call

Looking to hire for long-term or full-time assignments? See how Full-time hiring on Upwork simplifies the process.