Upwork home
Sign up
Secondary

Hire the best Web Crawler Developers in Egypt

Check out Web Crawler Developers in Egypt with the skills you need for your next job.
Get started
Clients rate Web Crawler developers
Rating is 4.9 out of 5.
4.9/5
based on 137 client reviews
  • $67 hourly
    • 4.9/5
    • (145 jobs)
    A Mechanical Engineer who is genuinely passionate about coding, I like to make boring tasks automated. ✔️ 4+ Years of Web Scraping, Automation and Bot Development ✔️ 4+ Years of Software Development ✔️ 1+ Year of Web Development I have expertise in the following ✔️ Python ✔️ Data Scraping ✔️ Selenium ✔️ Flask ✔️ API Development ✔️ VB.NET (Since 2015) ✔️ C# ✔️ Database Architecture (Design and Implementation) ✔️ Web Automation ✔️ Automated Web Bots ✔️ Web Scraping ✔️ Web Crawling ✔️ SolidWorks (Designing, Modelling and CFD) ✔️ Blazor ✔️ ASP.NET ✔️ English Language (IELTS B2) I am passionate about providing my clients with innovative design and development support. I know that user experience is everything to understand your customers and connect them with your business.
    Featured Skill Web Crawler
    Desktop Application
    Bot Development
    Browser Automation
    Data Entry
    API
    C#
    Web Development
    Data Extraction
    Web Scraping
    Web Crawling
    Automation
    Selenium
    Scripting
    Data Scraping
    Python
  • $20 hourly
    • 5.0/5
    • (58 jobs)
    ⭐ Need high-quality data to boost your projects? ⭐ Looking for lead generation to connect with potential clients? ⭐ Need to gather competitor product prices for comparison? ⭐ Want an automated scraper tool for daily data collection? Look no further! As an expert data scraper, I guarantee top-notch results at competitive prices. My expertise and commitment ensure your data needs are met with precision and accuracy. Let's collaborate to elevate your business to unparalleled success. Why Choose Me? With over Four years of experience in data extraction and ETL pipeline design, I specialize in: 🔸 Expertise: Proficient in Scrapy, Selenium, Requests, and BeautifulSoup for efficient data extraction. 🔸 Data Cleaning: Skilled in using regex for accurate and reliable data extraction. 🔸 API Integration: Extensive experience with JSON and Postman for seamless data access. 🔸 Database Management: Expertise in SQL Server and SQLite for efficient data storage and retrieval. 🔸 Quick Learner: Fluent in English with a knack for quickly adapting to new tools and technologies. 🔸 IP Rotations: Utilize VPNs and proxies to ensure smooth and uninterrupted scraping. 🔸 Cloud Deployment: Deploy scraping spiders to run in the cloud, saving local resources and ensuring efficient extraction. 🔸 Automation: Design spiders that automatically send data via email or Google Sheets for streamlined operations. Skills: ✅ Web Scraping: Python, Scrapy, BeautifulSoup, Regex, Requests ✅ Automation: Selenium, Dataloader ✅ Scripting Language: Bash ✅ Database Management: MySQL, PostgreSQL ✅ Data Cleaning: Python, Excel, SQL ✅ Pipeline Design: Airflow, Docker, Scrapy ✅ Other Skills: Git, GitHub, Postman, Excel, Burp Suite, API Integrations ❉ Can’t wait to work with you! 🤝
    Featured Skill Web Crawler
    API
    MySQL
    Elasticsearch
    Data Science
    Web Crawling
    Python
    Automation
    Apache Airflow
    Docker
    ETL Pipeline
    Web Scraping
    Data Engineering
  • $20 hourly
    • 5.0/5
    • (16 jobs)
    Experienced Python Developer with over 4 years of working experience in E-commerce, Lead Generation, Real Estate and Job Board Data Mining. Specialized in scraping data from various data sources using Python frameworks such as Scrapy, BeautifulSoup4 and Selenium WebDriver. 🎩Skills Summary • Data Scraping: Python (Scrapy, BeautifulSoup4, Selenium, Playwright, Requests) • Data Processing: Pandas, NumPy, Regex pattern matching • Data Cleaning: Microsoft Excel, Google Sheets, Data Analysis Functions. • Data Storage: SQL Server, MongoDB, CSV/JSON/Excel exports • Automation: Scheduled data pipelines, API integrations, real-time monitoring 📨 Available for both one-time projects and Long-term projects. Let's discuss how can I transform your requirements into valuable and actionable solutions!
    Featured Skill Web Crawler
    Google Sheets
    Microsoft Excel
    Data Cleaning
    Automation
    Web Crawling
    Online Research
    Scrapy
    Data Extraction
    Data Mining
    Data Analysis
    Market Research
    Data Scraping
    Web Scraping
    Python
  • $25 hourly
    • 4.9/5
    • (63 jobs)
    Full time scraping consultant specializing in web scraping, crawling, and indexing web pages. Working on projects that deal with automation and website scraping, crawling and exporting data to various data formats(CSV, JSON, EXCEL and DataBase). Here’s what you will get by working with me: ✔ 𝐓𝐎𝐏-𝐑𝐀𝐓𝐄𝐃 Freelancer Acknowledgement from Upwork⛷️. ✔ Working only on projects that I can deliver 100% ✔ Ridiculous quality of work ✔ Smart suggestions on increasing results/revenue and decreasing costs ✔ Responsibility for tasks/project I work on ✔ Reliability ✔ Short response time ✔ Excellent written and verbal English skills . keywords: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, web scraping, web crawling, automation, bots, scrapers, spiders
    Featured Skill Web Crawler
    Robotic Process Automation
    Database
    Browser Automation
    Telegram API
    Airtable
    SQLite
    XPath
    Automation
    Google Sheets
    Web Crawling
    Beautiful Soup
    Selenium
    Data Scraping
    Python
    Scrapy
  • $20 hourly
    • 5.0/5
    • (76 jobs)
    🏆 Pros of Hiring Me! ㅤㅤ✅ Top 3% Web Scraper & 1% Mobile Scraper On Upwork. ㅤㅤ✅ Massive Scraping Up to Millions of Rows. ㅤㅤ✅ Hosting and Scheduling Web Scrapers & Full Scraping System with Dashboards. ✅ 𝓐𝓿𝓪𝓲𝓵𝓪𝓫𝓲𝓵𝓲𝓽𝔂: 24/7 🟠𝙒𝙃𝘼𝙏 𝙄 𝘾𝘼𝙉 𝘿𝙊 𝙁𝙊𝙍 𝙔𝙊𝙐: 🔸 E-commerce Scraping: Amazon, Shopify, and WordPress. 🔸 Directory Scraping: Yellow Pages, White Pages, etc. 🔸 Search Engine Scraping: Google, Bing, and Yahoo. 🔸 Custom Web Scraping Tools: Tailored solutions for your unique requirements. 🔸 AWS Deployment: Utilizing AWS Lambda and integrating with other AWS resources. 🔸 Execute Large-scale Data Extraction & Rapid Web Scraping and Data Retrieval 🔸 Auto Login Web Scraping, Merge and Concatenate Files & Bulk Image Downloads 🔸 Provide Long-term Project Support & Maintenance 🔸 Scraping any available hidden data from various sources, ensuring comprehensive results. 🔸 Integrate advanced technology (Scrapy-Selenium, Scrapy-Playwright, Scrapy-Gsheets) ✅ 𝒜𝒹𝓋𝒶𝓃𝒸𝑒𝒹 𝒮𝑜𝓁𝓊𝓉𝒾𝑜𝓃𝓈: 🔸 Cloudflare, DataDome, PerimeterX, CAPTCHAs, IP blocking, Request rate limiting, Geotargeting, Proxy Rotation, and Concurrency. 🔸Training Provided: I offer training to help you operate the tools independently. 🔸CAPTCHA Solving: Ensuring uninterrupted data access by solving CAPTCHAs 🔸Custom Dashboards: Designing and hosting dashboards for remote scraper control. 🔸Scheduled Scraping: Creating APIs and setting up lambda functions for automated scraping ✅ 𝙔𝙊𝙐 𝙉𝙀𝙀𝘿 𝙈𝙀, 𝙄𝙁: 🔸 You're grappling with an incomplete project or a task others have struggled with. 🔸 You require expertise in handling complex and unstructured websites for data gathering. 🔸 You seek rapid and efficient web scraping and automation solutions. 🔸 You value your time and seek reliable support for data management and processing. ✅ 𝓦𝓱𝓪𝓽 𝓢𝓮𝓽𝓼 𝓜𝓮 𝓐𝓹𝓪𝓻𝓽: 🔸 Despite the varying sizes of projects, I approach each one with the same level of dedication and professionalism, ensuring exceptional results every time. ✅ 𝑴𝒀 𝑾𝑬𝑩 𝑺𝑪𝑹𝑨𝑷𝑰𝑵𝑮 𝑻𝑬𝑪𝑯-𝑺𝑻𝑨𝑪𝑲 🔸 Python, Scrapy, Playwright, Selenium, Requests-html, Requests, BeautifulSoup, Pandas, Numpy, MySQL, PostgreSQL, MongoDB, Sqlite3, CSS Selectors & Xpath, Concurrent Futures, and more. 🌟 What Others Say About My Work: "Thank you so much for your exceptional work! Your dedication and expertise have truly impressed us. We are highly satisfied with the results and look forward to collaborating with you again in the near future. You've proven to be a valuable asset to our team, and we can't wait to rehire you soon." "Ahmed was fantastic to work with and is a model for what freelancers on Upwork should do; He was incredibly quick to respond at all hours, provided ideas and suggestions for the project, was adaptable when I ran into an issue, and was looking to assist however he could. The overall work quality was great and he delivered exactly what I needed. I hope we’ll work together again on many future projects." Ready to collaborate? I'm just a message away! Or you can book a free discovery meeting to kickstart your project ASAP! 🚀
    Featured Skill Web Crawler
    Heroku
    Data Analysis
    Seaborn
    Data Visualization
    Bot Development
    Flask
    API Development
    Matplotlib
    Automation
    AWS Lambda
    Web Crawling
    Selenium
    Data Extraction
    Web Scraping
    pandas
    Beautiful Soup
    Data Scraping
    Python
    Scrapy
  • $20 hourly
    • 5.0/5
    • (13 jobs)
    Are you overwhelmed by data but missing key insights? I specialize in transforming scattered information into valuable, actionable strategies to make data work for your business. With over 6 years of experience in web scraping and data extraction, I aim to make data collection easy and reliable for you. My services include: ✅ Business and Lead Generation: Scraping leads from business directories, compiling medical and specialist directories, and gathering business and contact information. ✅ Product and Review Collection: We collect catalogs with images and manuals, scrape product and restaurant reviews, and capture product images and detailed specifications. ✅ Real Estate and Financial Data: Extracting data from real estate sites, and gathering financial information from major financial platforms. ✅ Custom Data Extraction: Collecting search engine rankings, and capturing specific HTML, JavaScript, or other source code elements from webpages. Every client's needs are unique, and I take a personalized approach to each project. My web scraping methods ensure that the data I deliver is accurate, comprehensive, and tailored to your goals. If you're ready to unlock the power of web scraping and gain valuable insights, reach out to discuss your project! I look forward to helping you achieve your data goals. Warm regards, Hossam Gamal
    Featured Skill Web Crawler
    API Integration
    SQL
    Python Script
    Web Crawling
    Data Scraping
    ETL
    Beautiful Soup
    Lead Generation
    Web Scraping
    Scrapy
    Python
    Selenium
    MySQL
    Data Extraction
  • $25 hourly
    • 5.0/5
    • (17 jobs)
    🏆 Perks of Hiring Me ㅤㅤ✅ Convenient Dealing, Advanced Web Scraping Methods with Long-term project support. ㅤㅤ✅ 𝙄 𝙝𝙖𝙫𝙚𝙣'𝙩 𝙛𝙖𝙞𝙡𝙚𝙙 𝙗𝙚𝙛𝙤𝙧𝙚 𝙩𝙤 𝙨𝙘𝙧𝙖𝙥𝙚 𝙖 𝙬𝙚𝙗𝙨𝙞𝙩𝙚. ✅ 𝓐𝓿𝓪𝓲𝓵𝓪𝓫𝓲𝓵𝓲𝓽𝔂: 24/7 🟠𝙒𝙃𝘼𝙏 𝙄 𝘾𝘼𝙉 𝘿𝙊 𝙁𝙊𝙍 𝙔𝙊𝙐: 🔸 Execute Large-scale Data Extraction 🔸 Rapid Web Scraping & Data Retrieval 🔸 Bulk Image Downloads 🔸 Auto Login Web Scraping 🔸 Merge and Concatenate Files 🔸 Develop Simple Scripts for PDF Downloading and Conversion 🔸 Provide Long-term Project Support & Maintenance 🔸 Scraping any available hidden data from various sources, ensuring comprehensive results. 🔸 Implement IP Rotation, Rate limiting, and Recaptcha Solving Services 🔸 Parallelism Techniques (Scrapy, Grequests, Concurrent Futures) ✅ 𝙔𝙊𝙐 𝙉𝙀𝙀𝘿 𝙈𝙀, 𝙄𝙁: 🔸 You're grappling with an incomplete project or a task others have struggled with. 🔸 You require expertise in handling complex and unstructured websites for data gathering. 🔸 You seek rapid and efficient web scraping and automation solutions. 🔸 You value your time and seek reliable support for data management and processing. ✅ 𝘽𝙀𝙉𝙀𝙁𝙄𝙏𝙎 𝙊𝙁 𝙒𝙊𝙍𝙆𝙄𝙉𝙂 𝙒𝙄𝙏𝙃 𝙈𝙀: 🔸 I commit to projects that I can deliver with utmost satisfaction. 🔸 I’ve created 30+ scrapers for the biggest and the hardest websites 🔸 Expect convenient collaboration and swift responses. 🔸 Relevant project-related suggestions. 🔸 I prioritize data cleanliness and user-friendliness. 🔸 Fluent in written and verbal English, I ensure clear communication throughout the process. 🔸 My services come at an affordable price without compromising on quality. 🟢 𝓦𝓱𝓪𝓽 𝓢𝓮𝓽𝓼 𝓜𝓮 𝓐𝓹𝓪𝓻𝓽: 🔸 Despite the varying sizes of projects, I approach each one with the same level of dedication and professionalism, ensuring exceptional results every time. ✅ 𝑴𝒀 𝑾𝑬𝑩 𝑺𝑪𝑹𝑨𝑷𝑰𝑵𝑮 𝑻𝑬𝑪𝑯-𝑺𝑻𝑨𝑪𝑲 🔸 Python, Scrapy, Selenium, requests-html, requests, Pandas, parsel, Grequests, MySQL, PostgreSQL, MongoDB, sqlite3, BeautifulSoup, CSS & path, playwright, Concurrent Futures, and more. 🕸️ 𝓟𝓡𝓔𝓑𝓤𝓘𝓛𝓣 𝓦𝓔𝓑 𝓢𝓒𝓡𝓐𝓟𝓔𝓡🕸️ 🔸 Amazon, eBay, Walmart, Google Business, Google Maps, Twitter, Instagram, Yelp, Glassdoor, Booking, Table scraper, Image scraper, Youtube, Apartments, Property Finder, LoopNet, Homes, Trulia, Realtor, Redfin, Zillow, Indeed, and many others. Check my portfolio for more. ✅ 𝓐𝓷𝓽𝓲-𝓑𝓸𝓽 𝓜𝓮𝓬𝓱𝓪𝓷𝓲𝓼𝓶𝓼 : 🔸 Cloudflare, DataDome, PerimeterX, CAPTCHAs, IP blocking, Request rate limiting, Geotargeting, Proxy Rotation, and Concurrency. ✅ 𝘿𝘼𝙏𝘼𝘽𝘼𝙎𝙀𝙎 𝙄 𝙐𝙎𝙀: 🔸 PostgreSQL, MySQL, MongoDB, SQLite3. 🔸 CSV, TSV, XLSX, JSON, Google Sheets. ✅ Get in Touch: 🔸 Test me with a challenge others have failed to crack, and prepare to be impressed. I've yet to encounter a website I couldn't scrape. If I can't handle your job, I'll refund you. Reach out, share your requirements, and let's discuss how I can assist you. Quick responses guaranteed—usually within an hour. Let's overcome your data hurdles together—schedule a Zoom call today! Best Regards, Mohamed Kalmoush
    Featured Skill Web Crawler
    Python Script
    CSV
    Script
    Automation
    Data Mining
    Web Crawling
    Selenium
    SQL
    Data Scraping
    Web Scraping Framework
    Beautiful Soup
    Scrapy
    Data Extraction
    Lead Generation
    Web Scraping
  • $20 hourly
    • 4.6/5
    • (111 jobs)
    🌐 Looking for programs to automate regular tasks on your web browser? 📊 Need data extracted for analysis or bulk uploads? ✨ It's time for your ideas to see the light! 💡 Hello! I’m Tarek , your go-to web scraping expert with over 3 years in data extraction, web automation, and data mining. Utilizing cutting-edge tools like Python, Scrapy, BeautifulSoup, and Selenium, I transform websites into rich data resources. I provide data in CSV, JSON, Excel, or Google Sheets formats, delivering fast, accurate, and ready-to-use data. 🚀 Services Offered: • Expert Web Scraping: Efficiently scraping dynamic websites, managing JavaScript rendering, pagination, and overcoming anti-scraping measures. • Custom Data Extraction: Delivering precise, high-quality data tailored to your business needs and adhering to best practices. • Web Automation Solutions: Automating tasks like form submissions, data processing, and report generation to enhance efficiency. • Data Processing & Integration: Cleaning, formatting, and storing data in databases, APIs, or cloud platforms. 🌐 Industry-Specific Expertise: • E-commerce: Amazon, eBay, Walmart, Shopify • Social Media: Facebook, Instagram, Twitter • Video Platforms: YouTube, Netflix • Music & Lyrics: Spotify, Genius • News & Media: The New York Times, CNN • Science & Research: Nature, ScienceMag • Finance: CoinMarketCap, Coinbase • Education: Coursera, Khan Academy 💡 Why Choose Me? • Proven Experience: Over three years in web scraping and automation, delivering actionable insights. • Advanced Solutions: Specializing in complex scraping tasks for hidden and dynamic data. • Reliable & Timely Delivery: Ensuring fast turnaround while maintaining data quality and accuracy. • Custom Solutions: Designed to meet your specific business objectives, maximizing data utility. • Global Reach: Experience working with diverse regions and challenging websites. If you need a dedicated web scraping expert, automation specialist, or data extraction professional, I’m here to assist you. Let's discuss how I can enhance your project with my expertise.
    Featured Skill Web Crawler
    Web Crawling
    Data Scraping
    Automation
    Data Entry
    Lead Generation
    Microsoft Excel
    Python-Requests
    Beautiful Soup
    Selenium
    Selenium WebDriver
    API
    Data Manipulation Language
    Web Scraping
    Data Extraction
    Python
  • $20 hourly
    • 5.0/5
    • (21 jobs)
    I have 2 years of experience in Data Analysis & Data Science projects (Academic, Professional). Skills: Expert in Data Analysis using Python. Data Extraction --> (python beautiful soap, Selenium, Scrapy, Scrapy_playwright, API). Data Cleaning --> SQL, Python(pandas, numpy), Excel. EDA --> Python(Pandas, Numpy), SQL(mysql), Excel. A/B Testing --> Python statsmodels. Data Visualization --> Python(matplotlib, seaborn, plotly), Tableau Dashboards Apply Machine Learning Models --> Python sklearn library. Certificates: -Udacity Data analysis nanodegree -Datacamp Associate Data Scientist certificate
    Featured Skill Web Crawler
    Web Crawling
    Data Cleaning
    Data Scraping
    Data Extraction
    Web Scraping
    Data Analysis
    SQL Programming
    Data Analytics & Visualization Software
    Scrapy
    pandas
    Python
    Tableau
  • $30 hourly
    • 5.0/5
    • (20 jobs)
    ✅TOP 3% Talent on Upwork❗ ✅100% Job Success❗ ✅19+ jobs completed successfully ❗ ✅58+ hours completed successfully ❗ ✅ Certified Python Developer ❗ Hello there❕ I specialize in Python development, managing a wide range of projects spanning from basic Python and JS client scripts to more intricate tasks involving Django, serverless backend, microservices architecture, Flask, REST APIs, Scrapy, web crawling, Selenium, browser automation and DevOps. ⭕My primary skill set includes: 🔺Python/Python scripting, Flask, FastAPI, JS, HTML/CSS 🔺NodeJS, ExpressJS, JavaScript, etc. 🔺AWS services like CloudFormation, AWS Lambda, Step Functions, API Gateway, CloudWatch, 🔺CodePipeline, RDS, IAM, ECS, IOT, EC2, and CloudFormation. 🔺Proficiency in SOLID principles and design patterns 🔺Python 3 standard library and AWS Python SDK (boto3) 🔺Mastery of SQL & NoSQL data models 🔺Django REST Framework/Django REST Swagger 🔺Databases: PostgreSQL, MySQL, and other SQL-based databases 🔺Frontend technologies: React/Redux, Angular, jQuery, and more 🔺Network programming using Python scripts 🔺Proficient in Linux server, Bash, Nginx, AWS, Docker, and Docker-compose 🔺Version control systems: GitHub/BitBucket 🔺Bug/Issue trackers: Youtrack, Jira, Trello As a professional developer, I meticulously manage every aspect of client projects, from understanding their requirements to coding and testing the final product. My goal is to deliver top-notch quality work at a competitive price and cultivate enduring relationships with my clients. "I believe every client should get his/her money's worth and that's what I offer and more .. " Feel free to get in touch with me❕
    Featured Skill Web Crawler
    Apollo.io
    Data Processing
    Data Warehousing & ETL Software
    Google Maps
    Data Collection
    Python Script
    Web Crawling
    Web Scraping
    pandas
    Selenium
    ETL
    Data Mining
    Beautiful Soup
    Data Extraction
    Data Scraping
  • $20 hourly
    • 5.0/5
    • (230 jobs)
    Hello! my name is Magdy. - I have 20+ years of experience working as a freelancer. - My main skill is to deliver on time, always communicate and put a big eye on details. I can help you for the following :- * Generate Barcode Labels from Excel Files * Generate Avery labels From Excel files * Extract Data from PDF files to Excel or CSV * Convert Single Label PDF to Avery Labels * Convert Avery Labels to Single Labels * Stamp PDF using Text , Image and Barcode * Split PDF File * Merge PDF files * Auto Print PDF files from folder * Auto print ZPL files from Folder * ZPL Programming
    Featured Skill Web Crawler
    Visual Basic
    Visual Basic for Applications
    Web Crawling
    Amazon
    Thermal Printer
    Adobe Acrobat
    Data Scraping
    Scripting
    Desktop Application
    Label & Packaging Design
    Copy Editing
    Microsoft PowerPoint
    PDF Conversion
    Microsoft Office
    Document Conversion
  • $35 hourly
    • 5.0/5
    • (18 jobs)
    If you’re looking to streamline your operations, get more done with less effort, and finally make your systems work for you, you’re in the right place. I’ve spent the past 8 years helping businesses automate workflows, optimize daily processes, and — more recently — bring in practical AI tools that actually make a difference (not just hype). I’ve worked with over 20 businesses across different industries, always with the same goal: better results, less chaos. ⸻ Here’s how I can help you: • 🔍 Workflow & Process Optimization I’ll break down how things are currently done and rebuild them to be faster, cleaner, and scalable. • ⚙️ Task Automation I automate time-consuming tasks — email flows, lead routing, reporting, you name it — so you and your team can focus on what really matters. • 🤖 AI Tools & Smart Assistants I build useful AI solutions like chatbots, GPT-based agents, and data-processing bots that actually save you time. • 🔗 System Integration I connect your tools (CRMs, databases, dashboards) so everything works together without the manual handoffs. • 📊 Real-Time Reports & Dashboards I help you track what’s working, what’s not, and where you can improve — all in simple dashboards that speak your language. ⸻ What you’ll get: • ✅ More clients served with the same team • ✅ Faster delivery = faster cash flow • ✅ Lower management stress • ✅ Total visibility across your operations • ✅ A system that grows with your business ⸻ Let’s make your business run smoother, smarter, and with way less hassle. Shoot me a message — even if it’s just to explore what’s possible!
    Featured Skill Web Crawler
    FastAPI
    Generative AI
    ChatGPT
    Google Sheets
    Web Crawling
    UiPath
    Marketing Automation
    Selenium WebDriver
    Process Modeling
    Data Analysis
    Zoho CRM
    Zapier
    Robotic Process Automation
    Python
  • $140 hourly
    • 5.0/5
    • (142 jobs)
    ✔️ Professional Web Scraping (Requests, Scrapy, Selenium, Playwright, Puppeteer, Splash) and many other frameworks. ✔️ Bypassing CAPTCHA | IP Blocks | CloudFlare | Akami | Impreva (EX. Incapsula) and multiple other Bot detection techniques. ✔️ Python Developer. ✔️ Running script over Cloud Servers (AWS/Google/Azure) and so on. ✔️ Regex Expert. ✔️ StackOverFlow Member for more than 10+ years. ✔️ MySQL/SQL and any SQL client framework as well. ✔️ Security Researcher and Security Penetration Testing. ✔️ Linux & Windows Servers Administration. ✔️ Certified Ethical Hacker "National EG-Cert CISO (ON-CALL)"
    Featured Skill Web Crawler
    Automation
    AWS Lambda
    Web Crawling
    JSON
    Web Scraping
    Data Extraction
    API
    MySQL
    Beautiful Soup
    Selenium
    Scrapy
    Python
    Data Mining
    pandas
    Data Scraping
  • $40 hourly
    • 5.0/5
    • (9 jobs)
    I am a highly experienced Full-Stack Developer and Automation Engineer specializing in reverse engineering, scalable SaaS solutions, and AI-driven lead generation systems. I bring a strong focus on autonomous end-to-end feature development and a ship-first, iterate-fast mindset, consistently delivering production-ready software that drives business impact. 🔵 Core Competencies: - Full Ownership of Features from Concept to Deployment I take complete responsibility for designing, developing, testing, and shipping robust features independently, ensuring rapid delivery without compromising quality. - Advanced Lead Generation & Outreach Automation Building intelligent automation platforms that leverage proprietary API integrations and OpenAI’s language models to deliver highly personalized, scalable engagement. - Reverse Engineering & Security Bypass Expertise Skilled in dissecting mobile and web applications using tools like Frida and Burp Suite to bypass security protections (SSL pinning, bot detection) and replicate private API workflows for seamless automation. Marketing Intelligence & Data-Driven Insights Developing comprehensive data pipelines and dashboards to monitor Shopify stores, Meta ad creatives, and digital funnels for high-value competitive analysis. - End-to-End Full-Stack Development & Scalable Infrastructure Expertise in Python (Flask/FastAPI), Next.js, PostgreSQL, and AWS to architect and deploy secure, maintainable, and scalable systems. 🔵 Latest Achievements: - Instagram Lead Generation Platform: Independently built a full-stack system combining reverse-engineered Instagram APIs with AI-generated personalized outreach messages via OpenAI LLMs, deployed on AWS with a Next.js dashboard. - Pinterest Account Warm-Up Tool: Engineered complex APK patching and runtime instrumentation to bypass app security, simulate OAuth, and automate Pinterest sessions. - BrandSearch.co (Co-Founder & CTO): Led the build and scale of a SaaS platform for Shopify store analytics and Meta ad intelligence, reaching CHF 10K MRR through fully autonomous product development and scalable infrastructure design.
    Featured Skill Web Crawler
    API
    Scripting
    API Integration
    Web Scraping
    Web Design
    Web Crawling
    MySQL Programming
    Automation
    JavaScript
    Data Extraction
    PHP
    Selenium
    Python
    Data Mining
    Data Scraping
  • $50 hourly
    • 4.9/5
    • (120 jobs)
    I hold a master's degree in artificial intelligence with proven experience working python developer for over 5 years ,working as a freelancer for other individuals. Since I have started development I have been spending every minute writing codes and learning everything new about it, also a lot of my work is on making new scripts and sites from scratch. I always aim to maintain a good relationship with my clients and if anyone lost his original developer i can step in and finish the work and take it where ever you need. Thanks!
    Featured Skill Web Crawler
    Selenium
    Beautiful Soup
    Data Scraping
    CSS
    API
    JavaScript
    HTML5
    XPath
    Bootstrap
    MySQL Programming
    Bot Development
    Web Crawling
    Scripting
    Scrapy
    Python
  • $25 hourly
    • 4.7/5
    • (8 jobs)
    Hi, My name is Omar Marouf and I am a data scientist. I am an undergraduate AI student. My main specialization is data science and its sub-related fields. However, I am quite good at automation, web scraping, NLP, and more. I've done several high-quality projects in different fields, and have the ability to make much more. In case you need any task or project related to python or programming in general, do not hesitate to contact me.
    Featured Skill Web Crawler
    Browser Automation
    Web Crawling
    Data Analysis
    Web Scraping
    Automation
    Tutoring
    Data Science
    C++
    Machine Learning
    Python
  • $25 hourly
    • 5.0/5
    • (20 jobs)
    Hello there! 👋 I'm **Waleed**, a curious and dedicated software engineer from Egypt. My journey began with a degree in computer science, and it wasn’t long before I was enchanted by the magic of code. My technical voyage has been thrilling, from mastering languages like `Python`, `JavaScript`, `C++`, and `C#`, to exploring frameworks like `Flask`, `Django`, and `Node.js`. I also enjoy crafting handy `Telegram bots` which has become a sweet spot of mine. 🌱 **Open-source Contribution**: The open-source ecosystem is a realm I find exhilarating. It’s a bustling community where the exchange of knowledge and collective growth flourish. My aim is to contribute valuable code that eases technology access and usability for everyone, everywhere. 💼 **Current Endeavors**: I am currently working on Django ,Node.js Projects and telegram bots with Python. 💖 **Why Sponsorship?** Your sponsorship resonates as an empowering pat on the back. It's more than financial aid; it symbolizes belief in my work and the broader impact that open-source creations can manifest. The funds will empower me to dedicate more time and resources to crafting, maintaining, and enhancing open-source projects. It's a stepping stone towards learning, growing, and reciprocating the goodwill in this dynamic community that has significantly shaped the tech landscape. 📚 **Beyond Coding**: When the code rests, my soul dives into the realms of **philosophy** and **literature**. The pursuit of wisdom and narrative adventures keep the intellectual wheels turning. 🤝 **Let’s Build Together**: Your support can catalyze not only my current projects but also ignite numerous impactful ventures in the days ahead. Thank you for considering sponsorship; every ounce of support propels a giant leap toward making a substantial difference in the open-source community.
    Featured Skill Web Crawler
    Data Mining
    Web Crawling
    Selenium
    Web Development
    Web Scraping
    Automation
    MongoDB
    Node.js
    Tailwind CSS
    CSS 3
    Python
    JavaScript
    HTML5
    Mongoose
    ExpressJS
  • $15 hourly
    • 5.0/5
    • (59 jobs)
    Your Satisfaction is Our Career. SPECIALTIES: * python * c# * Web scraping * Web Search * Data Mining * Data Processing * Product Upload (ebay, Amazon, wordpress, shopify, eCommerce) Trust : - I will believe in ourselves & build trust by being transparent & by always dedicated towards truth. Commitment : - I will be always committed by taking responsibility & no blaming. Timeliness : - I will respect time & be in time
    Featured Skill Web Crawler
    Web Crawling
    Scripting
    Data Extraction
    Selenium WebDriver
    Selenium
    Data Scraping
    Python
  • $20 hourly
    • 4.9/5
    • (46 jobs)
    With proven expertise in Python, Selenium, Playwright, httpx, cloudscraper, and requests,etc, I have a track record of delivering high-quality automation, web scraping, and data extraction tools in short turnaround times. experience in automating Google workspace (Sheets - Docs - Drive - Calendar - ...etc.) using Google Apps Scripts My specialty lies in using Python scripts to scrape data from public websites, with the ability to export results in various formats such as CSV, XLSX, JSON, SQL DB, MYSQL DB, SQL Lite, or Firebase. This means that I can tailor the output to your specific needs. In addition, I have the capability to develop desktop applications for browser automation that can accept both input data and randomly generated data. This makes the automation process more efficient, saving you time and effort. If you need someone with the technical know-how to develop effective automation and web scraping tools, look no further. My expertise in Python and related technologies, along with my experience in delivering quality results, make me a valuable asset to any project.
    Featured Skill Web Crawler
    Data Extraction
    Data Scraping
    Web Crawling
    Web Scraping Software
    Google Sheets Automation
    Google APIs
    Python Script
    Browser Automation
    Automation
    Desktop Application
    Bot Development
    Data Mining
    Python
    Selenium
    Web Scraping
  • $20 hourly
    • 5.0/5
    • (16 jobs)
    Scraping Expert passionate about data in different forms. Highly skilled in web scraping, data transformation, and data cleaning using Python, SQL, and ETL tools. What I do: ✔︎Web scraping & Automation ✔︎Data extraction & ETL ✔︎Data analysis, cleaning & data manipulation ✔︎Parsing data from HTML, XML, PDF, JSON Why hire me: - perfect communication throughout the project, available 24/7. - I take full accountability for my projects and I'm committed to delivering the best results. - reliable freelancer, I'm always ready for any sudden changes and new challenges. - provide lifetime consultancy and support for any scraper I build. - multiple revisions for data and scraper for quality assurance. - multiple and powerful machines for big projects and many scrapers. My Skills: ✳️Python ✳️Selenium ✳️Scrapy ✳️Beautifulsoup ✳️API requests ✳️MySQL/PostgreSQL/Mongo DB ✳️Zyte/Heroku Scheduler/AWS ✳️AWS/GCP/Heroku ✳️Docker ✳️Power BI I'm looking forward to long-term and successful contracts and I'm always passionate about bringing value to different businesses and looking for like-minded clients who are also fun to work with... So if that sounds like you, then feel free to reach out and let's talk.
    Featured Skill Web Crawler
    Python Script
    Automation
    Data Mining
    Data Collection
    Web Crawling
    Selenium WebDriver
    Python
    Web Scraping
    Scrapy
    Selenium
    Beautiful Soup
    Data Extraction
    Python-Requests
  • $15 hourly
    • 5.0/5
    • (3 jobs)
    I’m a Python developer with over 5 years of experience in web scraping, data automation, and ETL development, delivering 1000+ projects for global clients in e-commerce, PropTech, and online arbitrage. My expertise lies in crafting scalable crawlers with Scrapy, Selenium, and BeautifulSoup, bypassing anti-scraping measures to extract structured data efficiently. I optimized data pipelines with Apache Airflow, handling millions of URLs daily and cutting runtime by 25%. Key projects include an eBay Crawler for dynamic listings with proxy rotation and a Profit Hunter tool integrating Keepa and Google Sheets APIs for arbitrage. I excel at delivering data to MongoDB, PostgreSQL, or CSV, ensuring GDPR-compliant and ethical scraping. Clients value my clear communication, Agile collaboration, and commitment to deadlines. Ready to automate your data workflow? Let’s discuss your project!
    Featured Skill Web Crawler
    ChatGPT API Integration
    ETL Pipeline
    Data Engineering
    Web Scraping
    ETL
    Scrapy
    Data Scraping
    Python Script
    Web Crawling
    Automation
    Selenium
    JSON
    Python-Requests
    Python
  • $50 hourly
    • 4.7/5
    • (4 jobs)
    Techie | Cloud Engineer | Machine Learning Engineer | Cloud Architect | Building tools in a data driven mindset
    Featured Skill Web Crawler
    Data Scraping
    AWS Lambda
    Web Crawling
    Selenium
    Big Data
    MySQL
    Machine Learning
    C++
    Deep Learning
    Python
  • $25 hourly
    • 5.0/5
    • (6 jobs)
    I am a professional Data Analyst and Web Scraper with 2 years of coding experience. Looking for great projects that will provide me with challenging & interesting work that I can learn from and contribute to. Perfect quality & customer satisfaction are my top priorities. I can efficiently work in the following areas: ✅ Python, NumPy, Pandas for Data Analysis. ✅ Matplotlib, Seaborn for Data Visualizations. ✅ Sklearn Machine Learning. ✅ PyTorch Deep Learning. ✅ BeautifulSoup, Selenium for Web Scraping. Projects: • “Motivate” Bike share data Exploration. • “WeRateDogs” Twitter Page Data Wrangling. • European Soccer Database Investigation. • Analyze A/B Test results with Logistic Regression. • “Boston Bluebikes” Data Exploration & Visualization. • Predicting Bike-Sharing Data using Neural Networks. • Linkedin Scraping. • Dog-Breed Classifier using CNNs. • Generating TV Scripts using RNNs. • Face Generation using GANs. • 30 Days of Machine Learning Competition. If you want to have a look at some of my projects, check out my Github account 'AymanMet'.
    Featured Skill Web Crawler
    Data Analysis
    Automation
    Data Visualization
    Web Scraping
    Microsoft Excel
    HTML
    Data Mining
    Google Sheets
    Scripting
    Data Scraping
    Web Crawling
    SQL
    Tableau
    Machine Learning
    Python
  • $15 hourly
    • 5.0/5
    • (6 jobs)
    Hello there, I'm Mohamed Sadek, a Computer Engineer who in love with Data Analysis and Machine Learning. I have experience in programming, Problem Solving, Data Structure, Data Extraction, Data Processing, Data Cleansing, Data Visualization, and Machine Learning using: - Python - Pytorch - Numpy - Pandas - Matplotlib - Seaborn - Beautiful Soup * I'm in Love----
    Featured Skill Web Crawler
    Scripting
    Data Entry
    Data Mining
    Web Crawling
    Matplotlib
    Data Science
    ETL
    NumPy
    API Integration
    Data Scraping
    Python
    Beautiful Soup
    pandas
  • $20 hourly
    • 5.0/5
    • (6 jobs)
    🎯 As a highly skilled Python Developer with a focus on Web Scraping and Data Mining, my expertise lies in utilizing state-of-the-art tools and proven methodologies to efficiently extract, process, and analyze data from a variety of sources. I am dedicated to delivering tailored, high-quality solutions that meet your specific needs in a timely manner. 🔑 Core Competencies and Experience: 🐍 Proficient in Python programming language 🌐 Extensive experience with web scraping libraries (BeautifulSoup, Scrapy, Selenium, etc.) 📊 Data mining and data analysis using Pandas and NumPy 🤖 Well-versed in web automation tools (Selenium, Playwright, etc.) 📚 Knowledge of web protocols, APIs, and data formats (HTML, CSS, JSON, XML, etc.) 💾 Experience working with various databases (SQL, NoSQL, and cloud-based solutions) 🧠 Strong problem-solving capabilities with a focus on optimizing performance and accuracy 🗣️ Excellent communication and teamwork skills 🚀 Throughout my career, I have successfully completed numerous web scraping and data mining projects, enabling clients to make informed decisions and drive growth. I look forward to the opportunity to bring my expertise in data-driven solutions to your team and contribute to the success of your projects.
    Featured Skill Web Crawler
    Software Development
    Web Development
    Web Crawling
    Database
    Selenium
    Data Analysis
    Web Scraping
    Data Mining
    Scrapy
    SQL
    Python
  • $7 hourly
    • 4.8/5
    • (16 jobs)
    Expert with experience in scraping/crawling and automating the biggest and the most complex websites using the latest Python web scraping technologies e.g. Scrapy, Splash, Selenium, Requests, and BeautifulSoup.I Got a Kaggle 2x Master badge in Datasets and Notebooks. - Dealing with HTTP errors and Bypassing captcha - Quick turnaround, free samples, post-contract support. - Data extraction to CSV, SQLite, MySQL, PostgreSQL, MongoDB, and Google Sheets. - Authentication (login/password) - AJAX/JS Pagination - Super fast delivery of data with no hiccups in the delivery date Why I'm the best for You: ➡️Experienced Programmer ➡️Efficient Coding ➡️24/7 Availability ➡️Provide Free 1 months Support ➡️TeamViewer Support/Virtual Server/Any Desk ➡️Provide time/cost-effective solutions ➡️Give 100% Satisfaction Work
    Featured Skill Web Crawler
    Automation
    Web Crawler Framework
    Splash Screen
    Web Scraping Software
    Web Crawling
    Python-Requests
    Beautiful Soup
    Selenium
    Data Scraping
    Scrapy
    Web Scraping
    Web Scraping Framework
    Screen Scraping
    Data Extraction
  • $13 hourly
    • 5.0/5
    • (2 jobs)
    Hi there! 🚀 𝙇𝙤𝙤𝙠𝙞𝙣𝙜 𝙩𝙤 𝙪𝙣𝙡𝙤𝙘𝙠 𝙩𝙝𝙚 𝙥𝙤𝙬𝙚𝙧 𝙤𝙛 𝙙𝙖𝙩𝙖 𝙛𝙤𝙧 𝙮𝙤𝙪𝙧 𝙗𝙪𝙨𝙞𝙣𝙚𝙨𝙨? Whether it's web scraping, data extraction, or crafting tailored solutions, 𝙄'𝙫𝙚 𝙜𝙤𝙩 𝙮𝙤𝙪 𝙘𝙤𝙫𝙚𝙧𝙚𝙙! Let’s turn raw data into actionable insights and drive your success to the next level. Ready to get started? With over 5 𝙮𝙚𝙖𝙧𝙨 𝙤𝙛 𝙚𝙭𝙥𝙚𝙧𝙞𝙚𝙣𝙘𝙚 𝙖𝙨 𝙖 𝙋𝙮𝙩𝙝𝙤𝙣 𝙙𝙚𝙫𝙚𝙡𝙤𝙥𝙚𝙧 and 3+ 𝙮𝙚𝙖𝙧𝙨 𝙨𝙥𝙚𝙘𝙞𝙖𝙡𝙞𝙯𝙞𝙣𝙜 𝙞𝙣 𝙬𝙚𝙗 𝙨𝙘𝙧𝙖𝙥𝙞𝙣𝙜, I bring a wealth of expertise in using tools and libraries like Selenium, BeautifulSoup, Requests, and Scrapy to deliver high-quality, tailored solutions. 𝙎𝙚𝙧𝙫𝙞𝙘𝙚𝙨 𝙄 𝙊𝙛𝙛𝙚𝙧: ✅ Web Scraping & Data Extraction: Extract data from any website, including complex, dynamic, or paginated sites. ✅ Automated Data Entry & Form Filling: Streamline repetitive tasks with precision and efficiency. ✅ Product Uploading & Data Import: Seamlessly manage product data across platforms. ✅ File Management: Download images, process local files, and handle large datasets with ease. ✅ Data Management: Organize and analyze large text files, lists, and Excel spreadsheets. ✅ Telegram Bots: Automate publishing and messaging on Telegram channels. ✅ Social Media API Integration: Work with Twitter, Facebook, TikTok, and other APIs to automate tasks and extract insights. ✅ Custom Automation: Build chatbots, cryptocurrency trackers, and reminder systems for emails and texts. ✅ Excel Automation: Update and manage Excel sheets programmatically. 𝙒𝙝𝙮 𝘾𝙝𝙤𝙤𝙨𝙚 𝙈𝙚? ✨ Reliability & Commitment: I deliver projects on time, with a focus on quality and precision. ✨ Client-Centric Approach: Your success is my priority. I work closely with you to exceed expectations. ✨ Clear Communication: I respond promptly, provide regular updates, and ensure transparency throughout the process. ✨ No False Promises: I believe in honesty and delivering what I commit to. ✨ Efficiency & Expertise: With a deep understanding of data scraping and automation, I provide solutions that save you time and resources. 𝙇𝙚𝙩’𝙨 𝘾𝙤𝙡𝙡𝙖𝙗𝙤𝙧𝙖𝙩𝙚! I’m passionate about helping businesses leverage data to achieve their goals. Whether you need to extract insights, automate workflows, or build custom solutions, I’m here to make it happen. Let’s work together to turn your vision into reality and take your business to the next level. Ready to get started? Reach out today, and let’s discuss how I can help you achieve your objectives with precision and efficiency. 🚀
    Featured Skill Web Crawler
    Data Collection
    Scrapy
    Python
    Beautiful Soup
    Data Extraction
    Selenium WebDriver
    Web Crawling
    Automation
    Screen Scraping
    Data Mining
    Data Analytics
    Selenium
    Web Scraping
    Browser Automation
    Data Scraping
  • Want to browse more freelancers?
    Sign up

How hiring on Upwork works

1. Post a job

Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.

2. Talent comes to you

Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.

3. Collaborate easily

Use Upwork to chat or video call, share files, and track project progress right from the app.

4. Payment simplified

Receive invoices and make payments through Upwork. Only pay for work you authorize.

Top cities for Web Crawler Developers in Egypt
Show more