Upwork home
Sign up
Secondary

Hire the best Web Crawler developers

Check out Web Crawler developers with the skills you need for your next job.
Hire freelancers
Clients rate Web Crawler developers
Rating is 4.8 out of 5.
4.8/5
based on 4,287 client reviews
  2. Development & IT Talent
  3. Scripting Specialists
  4. (Current) Web Crawler Developers
  • $150 hourly

    • 5.0/5
    • (70 jobs)
    Hi there! 👋 I'm an Automation expert and Software Engineer with 7+ years of experience in process automation 🤖, RPA, scraping, software development, API, integrations, and CRM solutions (Python, Airtable, Directus, SuiteCRM, etc). As an expert-vetted freelancer, distinguished in the top 1% 🥇 of my category, my approach to automation and software development is client-centric 🎯 and solution-focused. I blend my extensive automation expertise with a deep foundation in cybersecurity, utilizing ethical hacking techniques and vulnerability assessment tools to craft secure, scalable, and efficient solutions tailored to your unique business needs. My expertise isn't just in automating processes but in doing so with a keen eye on efficiency, scalability, and security. I excel in leveraging AI, particularly OpenAI, to supercharge business process automation, crafting AI-driven solutions that tackle complex challenges. My proficiency spans a wide technology spectrum, including but not limited to ChatGPT/OpenAI, Zapier/Make.com, Shopify, Laravel/Symfony, Brevo, Smarlead, Dataforseo, ClickFunnels, MailChimp, Twilio, Stripe, Python, FastAPI, Flask... My services are not just about automating tasks; they're about creating smart, integrated systems that streamline operations, boost productivity, and secure your digital landscape. With a tech stack that includes Python, JavaScript, Typescript, PHP, and expertise in cloud solutions on AWS, Google Cloud, Azure and more, I bring a holistic approach to solving your automation challenges. What sets me apart: 1️⃣ Expert Integration: From sophisticated AI-driven automation to robust backend development, I leverage a comprehensive suite of tools (Make.com, Zapier, Python, PHP, Typescript, Node.js, Next.js) to ensure your systems are seamlessly interconnected. 2️⃣ Secure, Scalable Solutions: With a foundation in cybersecurity, every solution is designed to be not only effective but also resilient against digital threats. 3️⃣ Customized, Client-Centric Development: I build solutions grounded in your specific needs, employing SOLID principles to ensure scalability, maintainability, and efficiency. 4️⃣ Broad Industry Expertise: My extensive experience across sectors equips me with the versatility to navigate and solve complex problems, bringing a broad perspective and innovative solutions to your unique challenges. 5️⃣ Framework-Agnostic Approach: Unlike others who might be limited to specific frameworks or technologies, my agnostic approach allows for the flexibility to choose the best tools for the job, ensuring your solution is optimized for performance and sustainability Ready to transform your business processes with customized automation solutions? 📨 Contact me to explore how we can achieve your goals, whether for small-scale tasks or extensive projects, from conception to completion
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Python Script
    SugarCRM
    Laravel
    CRM Development
    Airtable
    SuiteCRM
    Zapier
    Python
    PHP
    API Integration
    Web Crawling
    Make.com
  • $23 hourly

    • 5.0/5
    • (23 jobs)
    Technologies I'm skilled at: 🛠 Backend development, AWS EC2/RDS/S3, Google Cloud VMs/BigQuery/MongoDB 🛠 Full scale scrapers (Scrapy/ScrapyRT/Splash/Zyte/Crawlera, browser emulation) 🛠 Bypass Cloudflare/Datadome/PerimeterX/Akamai/reCAPTCHA/hCaptcha/image captcha 🛠 HuggingFace/Transformers API/OpenAI/Embeddings 🛠 LLM deployment/serverless LLMs/batch LLM tasks 🛠 Inference/Fine-tuning/Quantization/text-to-text/image-to-text/spech-to-text 🛠 Vector DB/Milvus/pgvector/sentence transformers 🛠 Django/REST Frameworks/API development 🛠 Elasticsearch/AWS Athena 🛠 TOR relays, .onion websites data extraction, TOR nodes 🛠 pyTesseract OCR, AWS TextTract, open-cv2, LLMs for ETL 🛠 Bots development (Discord, Telegram, Microsoft Teams) 🛠 Python 3, Java, JavaScript, NodeJS, Ruby, shell scripting/Lua
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Back-End Development
    AI Model Training
    LLM Prompt Engineering
    Hugging Face
    REST API
    Redis
    Elasticsearch
    Amazon S3
    Selenium
    Amazon Web Services
    Google Cloud Platform
    Docker
    SQL
    Django
    Python
  • $179 hourly

    • 5.0/5
    • (195 jobs)
    If you're searching for the "Rolls-Royce" of PineScript and TradingView developers, you're in the right place. Clients have called me "The Sage of Solutions," "The Guru of PineScript," and "The Rolls-Royce of PineScript," backed by extensive positive reviews. 📈 Currently, I hold the top rank on Upwork for PineScript and TradingView development across all key metrics. As the co-founder of ChartPrime—one of the most respected vendors of TradingView indicators—I bring a wealth of experience to every project. My business partner at ChartPrime is the ex-cofounder of LuxAlgo, adding further credibility to our expertise in the trading world. Please note that ChartPrime is a separate entity from my Upwork services and team. 💡 Why choose me? I intentionally distance myself from bargain options because I work with serious traders who value exceptional results and understand the importance of investing in top-tier expertise. If you're looking for sub-$500 solutions that require constant oversight and numerous revisions, others might suit your needs. But if you want to save time and eliminate hassle by getting it right the first time, partnering with me and my team at My Trading Coder is your best decision. 💯 🏆 My track record speaks for itself. I've consistently proven my expertise, earning the right to be called the best. On Upwork, I maintain the #1 ranking for PineScript and TradingView programming services across all measurable standards. Compare my profile, feedback, and experience with any other freelancer, and you'll notice a significant difference in quality and results. 👥 I lead a team of hand-picked professionals under my company, My Trading Coder. Each member is personally trained to deliver work that meets my high standards. We're not an outsourced operation but a dedicated, cohesive group committed to excellence in every project we undertake. 🛠️ From the initial consultation to project delivery, our process is smooth and hassle-free. We take the time to fully understand your requirements, ensuring the final product not only meets but exceeds your expectations, with minimal need for revisions. ⏱️ Deadlines are not just met—they're often exceeded. Our goal is not only to deliver what you ask for but to anticipate your needs, ensuring your project doesn't just get done but stands out. 💰 Our pricing reflects the premium nature of our services: - Automated Trading Bots: $5,000 to $7,500 - Backtesting Solutions: $2,500 to $5,000 - Custom TradingView Indicators: $2,500 to $5,000 These rates may vary slightly based on project complexity. 📊 Our services include: - PineScript development for custom indicators, strategies, and scripts for TradingView. - Developing automated trading systems that connect TradingView indicators to brokers or exchanges, or building direct Python bots for customized trading solutions. - Advanced backtesting strategies in TradingView, as well as robust, tick-level backtesting through Python. 🎯 If you’re serious about trading and want to partner with the best, let’s talk. Once we establish a contract on Upwork, you'll have direct access to me via my personal cell phone 📱 and our in-house mobile app to manage your projects and communicate directly with my entire team. Let's elevate your trading strategies to the next level!
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    MQL 4
    MQL 5
    EasyLanguage
    MetaTrader
    MetaTrader 4
    MetaTrader 5
    NinjaTrader
    Trading Automation
    Pine Script
    TradingView
  • $45 hourly

    • 4.8/5
    • (117 jobs)
    Areas Of Expertise: Python, Scrapy, Requests, Selenium, MySQL/MongoDB, API, Linux, proxies, captcha solving, bots development.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Natural Language Processing
    Automation
    Reverse Engineering
    API
    Python Script
    Back-End Development
    MySQL
    PostgreSQL
    Data Scraping
    Selenium
    Python
    Scrapy
    Web Scraping
    API Integration
  • $50 hourly

    • 4.9/5
    • (267 jobs)
    Full-stack c# developer, extensive programming experience using ASP.NET Core, WPF, Devexpress, Devextreme, MySql
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Web Crawling
    Data Mining
    ETL
    Data Scraping
    Selenium
    .NET Core
    ASP.NET MVC
    ASP.NET Web API
    ASP.NET Core
    ASP.NET
    Python
    Web Development
    C#
  • $40 hourly

    • 4.9/5
    • (60 jobs)
    I have been in mobile development for 8+ years, especially iOS, since iOS 4. For the most of my time I have been working on in-house applications, and for the last 2 years, I am trying to contribute in any project that makes me excited. I have deployed more than 30 apps on App Store. And continuing to do so. I am also experienced at building backends for complex systems (on PHP most of the time) for mobile applications and web frontends. As a perfectionist, I try to make sure everyone gets satisfied with the quality of the job I have been assigned to, instead of just completing requirements.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    API Development
    Web Scraping
    API
    Web Crawling
    iPad UI Design
    iPhone UI Design
    Scripting
    iPad App Development
    Swift
    Objective-C
    API Integration
    PHP
    iOS Development
    Laravel
    Android App Development
  • $40 hourly

    • 5.0/5
    • (166 jobs)
    Since March 2014 I am a full-time freelancer dedicated to web scraping and browser automation projects. Working close to clients and creating long-time relationships, I've been part of many projects building large databases with scraped informations. I have scraped almost all types of websites with any kind of content: government tax payers websites, web directories, photo galleries, phone books, e-commerce websites, classifieds websites, etc. My area of expertise: Web Scraping, Web Crawling, Python Programming, Browser Automation, Selenium, MySQL and MSSQL Databases. I am also looking to extend my knowledge and experience in data science and machine learning.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Selenium
    Beautiful Soup
    Data Mining
    Data Scraping
    Data Management
    JSON
    Automation
    Data Extraction
    Data Entry
    MySQL Programming
    Web Crawling
    SQL
    Python
  • $20 hourly

    • 4.9/5
    • (17 jobs)
    With 5 years of experience in the industry, I am Abdullah Umer, a seasoned Full Stack Web Developer and Web Scraping Specialist. My expertise spans across frontend and backend development, DevOps, Data Engineering, and Generative AI, enabling me to deliver end-to-end solutions that are both innovative and reliable. 🎨 Frontend Development I specialize in creating intuitive and responsive user interfaces that engage users and enhance their experience. My expertise includes: React.js & Next.js: Developing dynamic and interactive web applications. TypeScript & Vue.js: Writing scalable and maintainable code. ShadCN UI, Material UI, Tailwind CSS: Designing modern and user-friendly interfaces. Figma & Adobe XD: Turning design concepts into reality with precision. Animation & Effects: Utilizing GSAP, Framer Motion, and React 3/React 3 Fiber/3 Drei for visually appealing effects. Chart.js & Lexical Editor: Implementing interactive data visualizations and advanced text editing features. SEO & Streaming: Enhancing search engine visibility and delivering seamless streaming experiences. 🚀 Backend Development I ensure robust, scalable, and efficient backend systems, with a focus on: Django, Flask, FastAPI: Building powerful and secure web applications. Node.js, Express, Nest.js: Creating high-performance backend services. Databases: Proficiency in MongoDB, Postgres, SQL, Supabase, and more. APIs & Integrations: Expertise in REST APIs, GraphQL, and integrating payment gateways like Stripe. Real-time Functionality: Implementing real-time features using Socket.io, Redis, Celery, Liveblocks, and GetStream. ⚙️ DevOps & Cloud Services I bring a DevOps mindset to every project, ensuring smooth deployments and reliable operations: CI/CD Pipelines & Git: Automating workflows for consistent and efficient releases. Docker & Kubernetes: Containerizing applications for scalability and reliability. Cloud Platforms: Leveraging AWS, Azure, and GCP for robust cloud solutions. Hosting & Deployment: Expertise in Vercel, Netlify, Heroku, Hostinger, and GoDaddy for seamless deployment. 🔍 Data Engineering & Web Scraping As a Web Scraping specialist, I have a deep understanding of data extraction and transformation: Scrapy, Selenium, Playwright: Efficiently scraping web data for analysis. Data Processing: Utilizing Pandas, Numpy, PySpark, and Hadoop for data manipulation. ETL Workflows: Building data pipelines with SQL, PostGres, Data Bricks, Mongo, and Google Sheets. Automation: Expertise in CronJobs and Django Rest Framework for automating data tasks. 🤖 Generative AI & Machine Learning I harness the power of AI to build intelligent systems that deliver real-world value: Python, LLM, LangChain: Developing advanced AI models. TensorFlow & PyTorch: Implementing deep learning models including CNN, RNN, GAN, and Auto Encoders. Robo Flow, YOLO: Specializing in computer vision and object detection. AI Integrations: Integrating AI solutions using Hugging Face, OpenAI, and custom chatbot development. Data Analysis & Visualization: Utilizing NLTK, PowerBI, and Tableau for insightful data interpretation. I am committed to delivering high-quality solutions that exceed client expectations. Whether it’s developing a full-stack web application, scraping data at scale, or creating cutting-edge AI models, I bring passion and precision to every project. Let’s collaborate to bring your ideas to life!
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    React
    PostgreSQL
    Django
    Automation
    JavaScript
    Web Crawling
    Web Scraping
    Lead Generation
    Python
    Scrapy
    Data Scraping
    SQL
    Beautiful Soup
    Data Extraction
    Selenium
  • $25 hourly

    • 5.0/5
    • (26 jobs)
    💎 TOP RATED PLUS - Top 3% of performers on Upwork, Level 3 certified UiPath & Electroneek ✅100% Job Success Score ✅8,500+ Hours Worked I am a Certified UiPath developer with 16+ years of experience in the IT industry and 6 years of experience in UiPath/Electroneek. I have automated Complex Backend/FrontEnd Business Processes which include CRM, SAP, Webbase CRM applications like NetSuite, Oracle EBS, Windows/Desktop applications, and Applications Running in Citrix Environment or Remote Desktop Connection (RDP) to automate repeatable tasks, Reading the data from PDF (tabular data specialist), Generate complex excel report, gather information from websites, interact with databases and work with web services.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Selenium
    Order Entry
    Automated Testing
    Automation
    PDF Conversion
    Web Crawling
    Bot Development
    Data Scraping
    Data Mining
    Robotic Process Automation
    C#
    Data Extraction
    UiPath
  • $50 hourly

    • 4.9/5
    • (49 jobs)
    With 7 years of experience and 60 successful projects, I specialize in delivering high-quality web scraping, crawling, and automation services. My expertise in Python, Selenium, Beautifulsoup ensures efficient and reliable data extraction and delivery in various formats, including Excel, CSV, JSON, and more. What sets me apart: - Extensive experience in handling complex scraping and automation tasks - Ability to deliver clean, structured, and actionable data - Timely delivery and open communication throughout the project - Customized solutions tailored to your specific requirements I have successfully completed projects for clients in various industries, including: - Financial services: Scraping financial data, market trends, and competitor analysis - Real estate: Extracting property listings, prices, and market insights - Sports: Gathering data on athletes, teams, statistics, and performance metrics - Legal services: Assisting with legal research and data collection - Marketing: Developing Google Ads scripts for campaign optimization and automation If you have a project in mind, let's discuss how I can help you achieve your goals. I am committed to providing exceptional service and delivering results that exceed your expectations. Feel free to reach out to me for a detailed quote and project timeline. I look forward to working with you!
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    MySQL
    API
    Web Scraping
    Selenium WebDriver
    Python
    PHP
    Data Extraction
    Selenium
    Scripting
    Data Mining
    Web Crawling
    API Integration
    Data Scraping
    Beautiful Soup
  • $25 hourly

    • 5.0/5
    • (16 jobs)
    I’m a full-stack developer. My base goal is prompt development and qualitative product. I was developing: - multi-thread scrapers of Instagram followers - analysis publication activity web products for a major university - scraping bots for Instagram and FUT web app (for FIFA21) - working with own OpenStreetMaps tail server - various API services My base stack technologies: - Node.js / Express - Docker - PostgreSQL / Sequelize - React / Bootstrap - Redis / RSMQ - MongoDB / Mongoose - Puppeteer - OSM maps It is important for me that my customer is satisfied with a reliable, secure, and supported product. I will try to find the best solution for your business!
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    API
    Sequelize
    Web Crawling
    Automation
    Data Mining
    Data Extraction
    RESTful API
    ExpressJS
    Node.js
    React
    Docker
    MongoDB
    Redis
    PostgreSQL
  • $30 hourly

    • 5.0/5
    • (18 jobs)
    I have helped build a number of sass products and profitable web apps that leverage web automation, NLP and data scraping pipelines. Some of the work that I do: ✅ data scraping, clean-up and visualization pipelines ✅ Full-stack SASS dashboards and web apps that use scraped data: I have developed all kinds of web apps with Node and React/Next. I have an eye for elegant design and I prioritise security, accessibility, usability and SEO. ✅ browser automation with puppeteer ✅ GPT- 3.5 / 4 based question answering and search engines from existing or scraped knowledge base ✅ API automation and bot programming ✅ Scheduled scrape jobs using cron and integration with a wide range of database technologies (MySQL, SQLite, Redis, Neo4j, Algolia, MongoDB) depending on your use case ✅ image to text conversion with OCR using tesseract at a scale ✅ batch processing and manipulation of spreadsheets, texts, pdf documents, images and audio ✅ advanced parsing and manipulation of text - fuzzy pattern matching at a scale ✅ custom NLP pipeline development I can scrape and automate sites: ✅ under cloudflare protection ✅ protected by captcha (2captcha integration) ✅ requiring login and/or 2FA ✅ with dynamic content rendered using javascript ✅ requiring proxies/IP rotation ✅ where pages are hidden, archived or not indexed ✅ having multiple levels of nesting ✅ where data is embedded in maps or charts With the following optimizations, I can scrape at the rate of upto 25 million rows/day: ✅ I have my own lightweight regex based parser for when speed is the priority ✅ I can push Puppeteer to the limits in terms of performance ✅ I can fully leverage node.js parallelism and concurrency to speed up scraping ✅ I can set up multiple synchronized servers for large scale scraping ✅ I have all the software engineering techniques under my belt to manage complex scraping codebases ✅ for large projects, I can interface the scraper with SQL/noSQL databases or cloud storage providers like Google drive ✅ I can reverse engineer the web client API to bypass UI overhead if possible, thereby significantly speeding up the scraper I have won a number of 🥇problem solving competitions🥇, both local and international. My skills and resourcefulness will come in handy while working under time constraints. Most importantly, I strive hard to live up to my clients' expectations.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    TypeScript
    Data Mining
    JSON
    Regex Writing
    Automation
    Data Visualization
    React
    Node.js
    Scripting
    D3.js
    Web Crawling
    JavaScript
    Data Scraping
    Data Extraction
    Python
  • $50 hourly

    • 4.7/5
    • (219 jobs)
    Grow your business by feeding it high-quality leads! Google Maps is widely regarded as the top source of leads, with billions of places data for all business categories. If you want to take advantage of this, you've come to the right place! I'm here to help you get the leads that fit your needs. My spiders are ready to go, so just contact me to start collecting leads. Together, we'll make sure your business reaches its full potential
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Selenium
    Data Mining
    Web Scraping
    Web Crawling
    Lead Generation
    Object-Oriented Programming
    Data Scraping
    Google Maps API
    API Development
    Laravel
    PHP
  • $45 hourly

    • 4.9/5
    • (70 jobs)
    I am a talented and experienced person. I have good experience with all skills, that I resumed and I am working as a freelancer for many years. I am a hard worker and enjoy working at all critical conditions. If hired by you I will be responsible to complete the task within the stipulated time frame and with utmost confidence. Outsource me for your project and I promise to bring in the best output.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Database
    Web Crawling
    Selenium
    Data Extraction
    Lead Generation
    Data Scraping
    JSON
    Data Mining
    XML
    PHP
    OpenCart
    Python
    WordPress
    Magento
    HTML
  • $10 hourly

    • 4.9/5
    • (312 jobs)
    I offers professional web data extraction and lead generation services. It is extremely important to me to meet the expectations of my clients, which is why I dedicate myself to making sure any job/task is done efficiently and accurately. With expertise in web scraping, data mining, and directory scraping, I can extract data from various sources and provide it in a structured format. Specializing in google maps navigation & skilled in finding targeted leads. As a specialist in lead generation and Google Maps navigation, I am SPECIALIZE IN= # 🇬🇴🇴🇬🇱🇪 🇲🇦🇵 🇸🇨🇦🇷🇵🇮🇳🇬 # Web Scraper / Data Mining / Directory Scraping / Data Extraction # Data crawl & mining from any source to Spreadsheet (ex- web / Images / PDF files etc). # LinkedIn Sales Navigator # Lead generation and #Google Maps navigation expert # An advanced use of Google Spreadsheets & Apps Scripts # In addition to advanced data manipulation, I provide other related services as requested. # Vehicle Data / Car Data / Real Estate / Prospecting / Contact list building / Google Map Additionally, very proficient in using google spreadsheets and Apps Scripts for advanced data manipulation. Clients can expect efficient and accurate work, tailored to meet their expectations.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Google Sheets Automation
    Google Search
    Google Maps API
    Google Maps
    Data Analysis
    Prospect List
    Data Scraping
    Company Research
    Data Extraction
    Instagram
    Lead Generation
    Web Scraping
    Web Crawling
    Google Sheets
    Real Estate
  • $24 hourly

    • 4.7/5
    • (54 jobs)
    - Serverless, Amazon AWS Lambda, SNS, DynamoDb, API Gateway - Node.js, Express.js - puppeteer / chromeless / aws-chrome-lambda - Phantomjs / CasperJs - Cheerio - DynamoDb, MySQL, MongoDB, SQLite - Svelte / Bulma - Accessing pages behind a login and through proxies, parsing data of any structure and complexity, automating routine tasks, such as clicking, scrolling, navigating etc.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Data Mining
    PhantomJS
    CasperJS
    JavaScript
    Web Crawling
    ETL
    Data Extraction
    Data Scraping
    PHP
  • $25 hourly

    • 5.0/5
    • (25 jobs)
    Innovative programmer and software developer with 5 years of experience. I always do my best to provide only excellent solutions with good timing, thus I: • Pay high attention to details and requirements; • Write clean and readable code; • Test the final results; • Make sure the delivery is on time. I will be glad to provide a free consulting session to discuss our cooperation 😊 𝐖𝐡𝐞𝐫𝐞 𝐚𝐦 𝐈 𝐬𝐭𝐫𝐨𝐧𝐠𝐞𝐬𝐭? I’ve committed myself entirely to Python so that I can achieve almost anything. I have enough experience to enter an existing project, quickly adapt, and improve my previous work. My main focus is: ✔️ Django (Back End Developing) ✔️ Python programming ✔️ Restful API (Django Rest Framework) ✔️ Web Scraping and web crawling ✔️ MySQL/PostgreSQL/SQLite ✔️ Git and GitHub
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Web Design
    Scripting
    Web Crawling
    RESTful API
    CSS
    Beautiful Soup
    HTML
    Docker
    Data Scraping
    Bootstrap
    Git
    Django
    PostgreSQL
    MySQL
    Python
  • $35 hourly

    • 4.8/5
    • (212 jobs)
    Web research and Automated data scraping solutions with custom developed scripts in Python or PHP Business leads eCommerce product listings Real Estate properties listing Business directory contacts geo locations from maps Get your data neatly organized in xlsx, csv, Google spreadsheet MySQL/MongoDB database optional Purchase the script so you can manually run from your PC or Host your script on a website, setup cronjob to run daily/weekly/monthly so you can get updated data Update/upgrade your product listing in eCommerce website (Shopify, WooCommerce, OpenCart) ~Developer with professional skills. Over 15 years of experience in IT related business. Years of successful work in creating Wordpress websites, SEO tools, server administration, data-mining, web research using mostly PHP/mySQL and Pyhon. Passionate web researcher. Linux/Unix system administrator. ~An experienced IT software/hardware support with BA in Computer Science. Excellent knowledge in programming languages (started with Visual Basic & Pascal in 1996, C, Java, Python ) Advanced knowledge in all MS Office programs (2yrs. working as Computer Trainer at ARC American Refugee Committee, teaching children Windows/MS Word/Excel basic/advanced courses) Basic knowledge in Corel Draw, Adobe Photoshop. Detail oriented and work enthusiastic. Highly responsive and excellent with deadlines. previous job experience: 2014 - 2018: Manager at PC Shop Infinity2002 2010 - 2013: IT Coordinator at Fluor Corp. providing IT support for USA Army in Afghanistan, Helpdesk support. Coordinates IT staff and resources to complete projects and resolve systems issues. Performs user support, technical assistance or other routine IT functional support activities as necessary Providing comprehensive IT infrastructure support to assigned location(s). Coordinating IT initiatives and implementing projects. Analyzing hardware, network and applications performance at assigned sites; identifying and implementing necessary upgrades or repairs as needed to improve functionality, usability, performance and/or reliability. 2002 - 2010: Manager at InfinityPlus Computers & Multimedia installing computer systems designing/printing advertising material including business cards, flyers, posters providing support for all IT related software/hardware issues
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    PHP
    B2C Marketing
    B2B Marketing
    Scripts & Utilities
    LinkedIn
    Web Crawling
    PDF Conversion
    Data Mining
    Lead Generation
    List Building
    Data Scraping
    Data Entry
    Email Marketing
    Online Research
  • $20 hourly

    • 5.0/5
    • (87 jobs)
    From ecommerce sites to social media, I have got you covered with my Python web scraping services. I am a professional Python developer and web scraper with extensive experience in challenging projects. My skills include data scraping, Instagram scraping, email extraction, Selenium, requests, and ecommerce website scraping. I have also developed desktop applications using PyQt5 and TkInter, and written automation scripts such as Discord bots. Web Scraping and Automation Services: Ecommerce website scraping and product extraction Selenium web testing and scraping Instagram and Twitter web scraping Email extraction from websites Data scraping from real estate, social media, and other types of websites Discord and Telegram bot development Automation scripts for various purposes As a professional desktop application developer in Python, I offer the following services: Development of custom desktop applications using PyQt5 and TkInter Integration of third-party APIs and libraries UI/UX design and development Maintenance and updates for existing applications Testing and debugging to ensure smooth operation I have a track record of delivering high-quality results and am dedicated to customer satisfaction. Contact me to discuss your project and see how I can help. Thanks.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    PyQt
    Social Media Marketing
    Python Script
    Data Mining
    Instagram API
    Web Development
    Scripting
    Desktop Application
    Web Crawling
    Selenium WebDriver
    Selenium
    Data Scraping
    Web Scraping
    Python
    Data Extraction
  • $48 hourly

    • 5.0/5
    • (205 jobs)
    FileMaker Pro Do you want to, 1. Create FileMaker Pro solutions for Mac and Windows 2. Create FileMaker Go applications for iPad or iPhone 3. Integrate third party plugins with existing FileMaker solution 4. Integrate external REST APIs with FileMaker 5. Show FileMaker data on website 6. Sync offsite database with server database using MirrorSync or GoZync 7. Install and administer in-house FileMaker Server or FileMaker Cloud 8. Modify or add new features/reports in existing database Bubble.io 1. No code platform that facilitate to build web apps quickly 2. Supports all major browsers 3. Responsive for different devices Zoho Creator 1. Low code cloud solution can be a best choice for small and medium businesses 2. Accessible at browser and both Android and iOS mobile apps 3. Great functionalities in quick turnaround time Send me a message. Let us discuss your requirements.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    C#
    CSS
    Microsoft Access
    MySQL
    FileMaker WebDirect
    Claris FileMaker
    .NET Framework
    HTML
    AJAX
    Visual Basic
    jQuery
    PHP
    JavaScript
    Web Crawling
    Data Scraping
  • $30 hourly

    • 5.0/5
    • (71 jobs)
    Known Skills :- Core JAVA , JavaFX, SpringBoot, REST Api Expert in Core Java. Expert in creating any kind of Desktop Applications using JavaFX. 100 % accuracy and 100 % client satisfaction.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Data Scraping
    XML
    Online Research
    Web Crawling
    HTML
    ETL
    JavaFX
    Java
    Desktop Application
    MongoDB
  • $50 hourly

    • 5.0/5
    • (114 jobs)
    - Backend / Cloud - Python ● Flask ● MySQL ● Digitalocean ● GIT ● Docker - Frontend - HTML5 ● CSS3 ● JavaScript - Hardware / OS - Linux ● Raspberry Pi - Me - I'm a life long learner always expanding my skill set and looking for projects to drive me forward as a developer and as a human being. I write appropriately commented, object oriented, PEP8 compliant code for project types including: web automation ● file processing ● consuming / creating REST APIs. Right now I'm most interested in building out data subscription services and working on light-weight full stack web applications, but I could be open to anything. Get in touch if you think I might be a good fit for your project!
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Flask
    Data Scraping
    Web Crawling
    Beautiful Soup
    Data Mining
    Data Extraction
    Python
  • $20 hourly

    • 5.0/5
    • (6 jobs)
    I'm a Full-stack Developer with expertise in a wide range of technologies, including C#, Angular JavaScript, and REST API development. With several years of experience in the field, I've developed both web and desktop applications for clients across a variety of industries. Whether you're looking to build a new web or desktop app from scratch or need help maintaining an existing project, I'm here to help. Let's work together to bring your vision to life!
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    TypeScript
    Angular
    .NET Core
    Microsoft SQL Server
    ASP.NET Web API
    Web Scraping
    .NET Framework
    Web Application
    JavaScript
    Data Scraping
    C#
    MySQL
    Data Extraction
    Web Crawling
  • $15 hourly

    • 5.0/5
    • (31 jobs)
    Do you have a task that you need automated? A Telegram bot idea you want to be brought to life? Or even better, a telegram bot to automate your tasks? Or a Telegram webapp for cryptocurrency mining? Basically anything Telegram or anything bots?! Then I'm your guy! I specialize in: -Python Programming Language -Telegram bot development -Telegram WebApp development -Telegram mass messaging -Web scraping -Web automation I automate anything I possibly can!
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Telegram API
    Web Scraping
    Machine Learning
    Web Crawling
    Chatbot Development
    Bot Development
    Automation
    Data Scraping
    Data Science
    Chatbot
    Heroku
    Selenium
    Telegram
    Python
  • $15 hourly

    • 5.0/5
    • (71 jobs)
    🏆 Pros of Hiring Me! ㅤㅤ✅ Top 3% Web Scraper & 1% Mobile Scraper On Upwork. ㅤㅤ✅ Massive Scraping Up to Millions of Rows. ㅤㅤ✅ Hosting and Scheduling Web Scrapers & Full Scraping System with Dashboards. ✅ 𝓐𝓿𝓪𝓲𝓵𝓪𝓫𝓲𝓵𝓲𝓽𝔂: 24/7 🟠𝙒𝙃𝘼𝙏 𝙄 𝘾𝘼𝙉 𝘿𝙊 𝙁𝙊𝙍 𝙔𝙊𝙐: 🔸 E-commerce Scraping: Amazon, Shopify, and WordPress. 🔸 Directory Scraping: Yellow Pages, White Pages, etc. 🔸 Search Engine Scraping: Google, Bing, and Yahoo. 🔸 Custom Web Scraping Tools: Tailored solutions for your unique requirements. 🔸 AWS Deployment: Utilizing AWS Lambda and integrating with other AWS resources. 🔸 Execute Large-scale Data Extraction & Rapid Web Scraping and Data Retrieval 🔸 Auto Login Web Scraping, Merge and Concatenate Files & Bulk Image Downloads 🔸 Provide Long-term Project Support & Maintenance 🔸 Scraping any available hidden data from various sources, ensuring comprehensive results. 🔸 Integrate advanced technology (Scrapy-Selenium, Scrapy-Playwright, Scrapy-Gsheets) ✅ 𝒜𝒹𝓋𝒶𝓃𝒸𝑒𝒹 𝒮𝑜𝓁𝓊𝓉𝒾𝑜𝓃𝓈: 🔸 Cloudflare, DataDome, PerimeterX, CAPTCHAs, IP blocking, Request rate limiting, Geotargeting, Proxy Rotation, and Concurrency. 🔸Training Provided: I offer training to help you operate the tools independently. 🔸CAPTCHA Solving: Ensuring uninterrupted data access by solving CAPTCHAs 🔸Custom Dashboards: Designing and hosting dashboards for remote scraper control. 🔸Scheduled Scraping: Creating APIs and setting up lambda functions for automated scraping ✅ 𝙔𝙊𝙐 𝙉𝙀𝙀𝘿 𝙈𝙀, 𝙄𝙁: 🔸 You're grappling with an incomplete project or a task others have struggled with. 🔸 You require expertise in handling complex and unstructured websites for data gathering. 🔸 You seek rapid and efficient web scraping and automation solutions. 🔸 You value your time and seek reliable support for data management and processing. ✅ 𝓦𝓱𝓪𝓽 𝓢𝓮𝓽𝓼 𝓜𝓮 𝓐𝓹𝓪𝓻𝓽: 🔸 Despite the varying sizes of projects, I approach each one with the same level of dedication and professionalism, ensuring exceptional results every time. ✅ 𝑴𝒀 𝑾𝑬𝑩 𝑺𝑪𝑹𝑨𝑷𝑰𝑵𝑮 𝑻𝑬𝑪𝑯-𝑺𝑻𝑨𝑪𝑲 🔸 Python, Scrapy, Playwright, Selenium, Requests-html, Requests, BeautifulSoup, Pandas, Numpy, MySQL, PostgreSQL, MongoDB, Sqlite3, CSS Selectors & Xpath, Concurrent Futures, and more. 🌟 What Others Say About My Work: "Thank you so much for your exceptional work! Your dedication and expertise have truly impressed us. We are highly satisfied with the results and look forward to collaborating with you again in the near future. You've proven to be a valuable asset to our team, and we can't wait to rehire you soon." "Ahmed was fantastic to work with and is a model for what freelancers on Upwork should do; He was incredibly quick to respond at all hours, provided ideas and suggestions for the project, was adaptable when I ran into an issue, and was looking to assist however he could. The overall work quality was great and he delivered exactly what I needed. I hope we’ll work together again on many future projects." Ready to collaborate? I'm just a message away! Or you can book a free discovery meeting to kickstart your project ASAP! 🚀
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Heroku
    Data Analysis
    Seaborn
    Data Visualization
    Bot Development
    Flask
    API Development
    Matplotlib
    Automation
    AWS Lambda
    Web Crawling
    Selenium
    Data Extraction
    Web Scraping
    pandas
    Beautiful Soup
    Data Scraping
    Python
    Scrapy
  • $20 hourly

    • 5.0/5
    • (78 jobs)
    We are a software development team coming from different fields including PHP, Javascript, MySQL, jQuery, Java, etc. We provide efficient and effective solutions for our clients. Mainly, our business contains: 1) Website Application 2) Mobile Apps Application 3) ERP System 4) Custom Software Trust us and we will finish your task timely and effectively.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    Data Entry
    Data Scraping
    Web Crawling
    Automation
    Translation
    Data Extraction
    API
    Chinese
    Virtual Reality
    Website
    MySQL
    HTML
    Java
    PHP
  • $50 hourly

    • 5.0/5
    • (76 jobs)
    Greetings! I am Max, a seasoned Python developer with over six years of specialized experience in data extraction, scraping, and analysis. I have mastered a wide array of libraries and tools to proficiently gather and process data from various sources. I possess in-depth expertise in libraries such as Requests, aiohttp, and httpx, coupled with proficiency in content analysis tools like lxml and BeautifulSoup. My niche skill set includes analyzing mobile app traffic, which is invaluable for extracting complex data from mobile applications. In browser emulation, I am skilled in utilizing libraries such as Playwright and Selenium, enabling me to replicate real user behavior and analyze web traffic meticulously. My background extends beyond data extraction; as a backend developer, I am experienced with Flask and FastAPI, and I adeptly manage databases including Postgres, MongoDB, and Redis. I am also proficient in constructing efficient data pipelines with Celery, ensuring seamless data processing and cleaning. My diversified experience covers roles in both outsourcing and product-based companies, consistently yielding top-quality outcomes and client satisfaction. Notable projects in my portfolio encompass extensive data collection and analysis for platforms like Twitter, in-depth evaluation of video content and analytics for YouTube channels, and the development of sophisticated data collection and processing pipelines with Celery. My expertise also includes extracting data from leading real estate websites such as Zoopla, Zillow, Redfin, and Hemnet, as well as managing substantial data from e-commerce giants like Amazon, Walmart, and Home Depot. Moreover, I played a pivotal role in architecting a comprehensive system for collecting and analyzing social media posts. I am driven by new challenges and committed to assisting clients in achieving their goals with precision and innovation. If you are in pursuit of a dedicated and expert Python developer with a deep focus on data extraction, traffic analysis, and scraping, I am keen on the opportunity to connect and contribute to your success.
    vsuc_fltilesrefresh_TrophyIcon Web Crawler
    ETL
    Web Scraping
    Scrapy
    Data Engineering
    Data Analysis
    Back-End Development
    MongoDB
    PostgreSQL
    Web Crawling
    pandas
    Data Extraction
    Python
    Data Scraping
    Python-Requests
    Selenium
  • Want to browse more freelancers?
    Sign up

How it works

1. Post a job

Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.

2. Talent comes to you

Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.

3. Collaborate easily

Use Upwork to chat or video call, share files, and track project progress right from the app.

4. Payment simplified

Receive invoices and make payments through Upwork. Only pay for work you authorize.

Trusted by

At A Glance: Web Crawler

Everyone knows there are unimaginable amounts of information available on the Internet — everything from the fascinating and useful to the obscure and pointless. Finding that one little piece of information among the flood would be nearly impossible without search engines. But how do search engines find that information for us? They employ something called a web crawler. While the mental image may be of a computerized spider crawling through the Internet, the reality is that these programs scan the web for the information requested; they’re also known as bots. The crawler checks a page for the word or words it has been instructed to find and compiles the results into an index.

This means web crawlers have a variety of vital uses to a business, as well as to an individual, and when it comes to catching crawlers’ attention in the right way, a business will often opt to hire web crawler specialists on Upwork to do the job. Part of the reason for this is that crawlers can’t always see everything on a website, with dynamic content topping the list of things that can confuse them. Animations, forms, and flash content can also get past crawlers, meaning a website might not show up in search results as it should. Therefore, a freelance web crawler specialist is able to ensure all the information on a site can be seen by the crawlers and therefore added to those all-important search indexes.

Schedule a call

Looking to hire for long-term or full-time assignments? See how Full-time hiring on Upwork simplifies the process.