Hire the best Scrapy Developers in Canada
Check out Scrapy Developers in Canada with the skills you need for your next job.
- $40 hourly
- 5.0/5
- (35 jobs)
🌟 Senior Developer Specializing in Automation, Data Parsing, and Web Development Greetings! I'm a seasoned senior developer with a passion for crafting elegant solutions through automation, precise data parsing, and dynamic web development. My expertise extends across a spectrum of skills, ensuring comprehensive support for a wide range of projects. 🚀 Expertise Highlights: 💫 1. Automation Maestro: Mastering the art of automation, I streamline processes to perfection, saving valuable time and resources. 🦋 2. Data Parsing Virtuoso: With meticulous precision, I parse and analyze data, unlocking valuable insights for informed decision-making. ✨ 3. Web Development Wizardry: From captivating websites to sleek mobile applications, I craft engaging digital experiences that resonate with users. 🕸 4. Social Media Automation Guru: Leveraging advanced techniques, I've automated renowned social platforms including Twitter (X), TikTok, Tinder, Instagram, and Reddit, driving efficiency and scalability. 🛠️ Skills Toolbox: - Automation Frameworks - Data Parsing Algorithms - Web Development Technologies: - HTML - CSS (including SCSS and SASS) - JavaScript (including jQuery) - Vue.js - React JS - PHP - Python - TypeScript - Bootstrap framework - Social Media API Integration - Database Management - Version Control (Git) 🌐 Available to Elevate Your Projects: I'm committed to delivering excellence and driving success for your projects. Let's collaborate to turn your visions into reality!ScrapyBeautiful SoupSeleniumAutomationBot DevelopmentPythonAPIPHPHTMLWordPressCSSVue.jsJavaScriptSCSSReact - $60 hourly
- 5.0/5
- (7 jobs)
Software Developer: Proficient in automated environments, adept at complex problem-solving. Technologies: Python, Bash, Ubuntu, Docker, MySQL, Javascript, MongoDB, Flask Browser Automation/Scraping: Develops scripts for Windows, Mac, Linux for real-time browser automation, including API interactions. Specializes in bots for captcha solving, sneaker purchases, and anti-bot measure circumvention. Skills: WebSocket scraping, JavaScript, DOM interaction, cookie/session management, API and HTML parsing. Technologies: HTML/CSS/JavaScript/JSON/XML, Scrapy, BeautifulSoup, XPath, Regex, Selenium. Networking/System Admin: Expert in service exposure on Linux, Windows, Mac for programmatic applications. Skilled in iptables, proxy server configuration, VPN management, and virtual machine operations. Proficient in RESTful API development and MySQL database management. Technologies: Docker, VPN protocols, HTTP/SOCKS proxies, Linux/Windows/Mac networking tools. Machine Learning/Vision: Focus on real-time captcha solving using machine vision. Experienced in NLP extraction with GPT models and AWS Sagemaker deployment. Technologies: Machine learning algorithms, AWS Sagemaker, GPT, vision processing tools. Cloud Platforms: I primarily use AWS, and EC2s to spin up and spin down instances in order for scaling tasks.ScrapyWeb CrawlingMongoDBPython-RequestsBeautiful SoupBrowser AutomationDockerLinuxData ScrapingSeleniumWeb ProxyRESTful APIFlaskSQLPython - $30 hourly
- 5.0/5
- (6 jobs)
Experienced System Designer with a successful track record in the information technology and services industry. Skilled in full-stack development, project management, and deployment. Strong engineering professional with a Bachelor's degree focused in Bachelor in Computer Science and Information Technology from Tribhuvan University. Currently, I'm pursuing an Ontario graduate certificate in the Artificial Intelligence and Machine Learning program to explore and grab opportunities in the data science and AI industries. Skills Language: C, C++, Python, Java, HTML, CSS, Javascript Libraries: Pandas, NumPy, Scikit-Learn, NLTK, Matplotlib, Seaborn, Regular Expression, Redux Framework: Django, Flask, Tensorflow, PIP, Nginx, Node, Express, React, TypeScript, JQurey, JSON, AJAX, Bootstrap, GraphQL Tool: Tableau, Power BI, Docker, Jira, Trello Cloud: AWS EC2, ECR, S3, Azure Database: SQL, MongoDB Systems: Windows, Ubuntu, Macintosh CI/CD: Github, GitLab, Bitbucket, WebhooksScrapySeleniumAmazon ECSClean ArchitectureAI Model DevelopmentSQLPyTorchTensorFlowNode.jsTypeScriptReduxDockerReactDjangoPython - $30 hourly
- 5.0/5
- (21 jobs)
Mostly working on user interfaces, workflow automation, utility tools, GIS, data scraping, databases. Coming from a previous career as a biologist, look no further if you want a communicative and rigorous freelancer with problem solving skills.ScrapyGISData ScienceData ScrapingData Mining - $50 hourly
- 4.8/5
- (4 jobs)
🚀 With over a decade of experience in full-stack development, I specialize in NodeJS, Python, React, and React Native. I excel in creating robust and scalable software solutions and am eager to bring my technical expertise and strategic insight to your project. Let's connect! Key Skills: - JavaScript, TypeScript, React, React Native - Python, FastAPI - Node, Express, NestJS, Microservices, GraphQL - AI/LLM/ChatGPT - MongoDB, Postgres, MySQL - AWS, Digital Ocean, Google Cloud deployment - GitHub, Docker, Kubernetes, CI/CD - Integrations with Stripe, Zapier, Make.com, Intercom, Salesforce, Hubspot, PipeDrive 🌟 I have a proven track record of leading diverse teams and delivering projects from inception to completion. My approach ensures regular, transparent communication and robust project oversight. 🏅 Committed to maintaining high standards of communication, I believe that consistent updates are the key to project success. Let's discuss how I can bring your project to life with precision and clarity. 📈 My tailored approach meets the unique needs of each project, ensuring efficient management and exceptional outcomes. If you need someone who can oversee both the big picture and the finer details, I'm here to help. ✨ Ready to elevate your project with top-tier engineering expertise? Schedule a consultation today, and let's achieve your goals together.ScrapySalesforceSlackHubSpotData MiningMake.comZapierScriptPythonBitcoinAPIArchitectural DesignSoftwareAPI Integration - $35 hourly
- 5.0/5
- (7 jobs)
I'm currently a master's student in the field of software engineering at the University of Calgary and I have 3 years of experience in the industry. The main focus of my work is developing web services using Django and Python. Along my journey in industry I have worked with Python, Golang, Kubernetes, gRPC, Docker, Redis, PostgreSQL, and Gitlab CI/CD. Here is a list of things that I have done in my former company: – Developed and maintained several scalable systems with millions of users – Simplified deploy process using Gitlab CI and reduced risk of deploying by providing automated tests and code linters to projects – Implemented a microservice for automating the whole procedure of receiving raw contents from admins, converting them to HLS files, and offering them to users – As the system owner, improved the quality of the services by applying clean code rules and writing tests, the response time of APIs by inspecting the queries in detail – Managed several CDNs and S3 buckets for media filesScrapySelenium WebDriverAutomated Deployment PipelineAPISeleniumCI/CDDjangoGolangSQLPythonPostgreSQL - $35 hourly
- 4.9/5
- (16 jobs)
Hello! I am a Top Rated freelancer on Upwork and an experienced SEO specialist with a focus on technical SEO. My expertise lies in optimizing website structures, improving site speed, and implementing best practices for search engine crawlers. With my technical skills, I can help you save a significant budget on pointless link-building strategies. As a Top Rated freelancer and technical SEO specialist, I possess a wide range of skills that are essential for improving website performance and driving organic traffic. Some of my key skills include: ➡️ Knowledge of HTML, CSS, and JavaScript ➡️ Proficiency in Google Analytics and Google Search Console ➡️ Understanding of keyword research and analysis ➡️ Familiarity with XML sitemaps and robots.txt files ➡️ Experience with website audits and technical issue resolution ➡️ Ability to implement schema markup and other structured data formats With my technical SEO skills, I can help your website rank higher on search engine results pages and attract more organic traffic. If you are looking for a Top Rated SEO specialist who can optimize your website's technical aspects and improve its overall performance, then look no further! Let's work together to achieve your online goals. ⚽ Contact me now to discuss how we can improve your website's search engine visibility and drive more organic traffic.ScrapyGoogle AnalyticsBot DevelopmentSEO Keyword ResearchSEO ContentSEO BacklinkingHTMLData MiningSeleniumBeautiful SoupData ScrapingPythonAPI IntegrationData ExtractionWeb Scraping - $49 hourly
- 5.0/5
- (1 job)
Hello Upworkers. I am a full-stack software engineer with over 10 years of website/shopify app development experience. My customer’s satisfaction is my utmost priority and I will not rest till you are satisfied! I have a passion for making technology work for people, and I love nothing more than helping non-technical people understand what technology can do for them and their organizations. I could get a lot of rich experiences that are really necessary for a talented software developer. Being self-motivated, able to work independently or be a part of the team, meet deadlines, follow the requirements even if it's too strict, … I'm very proficient in working with: - React/Redux, React Native, VueJS/Vuex for the frontend - Building Shopify App with React + Node.JS stack - NodeJS/ExpressJS for the backend - Map with Mapbox, Google Map and Leafleat.JS - Data Scraping / Data Extraction with Python Scrapy, Splash, Selenium, Puppeteer, Nokogiri and much more. - Agile Scrum Development, Jira, Github, Gitlab, Bitbucket Specifically, I have very deep knowledge and experiences in building shopify app to attract more people for the merchants. If you need to troubleshoot or update an existing app, I can also help as I have outstanding debugging skills. Happy to discuss projects, ideas, and things we can arrange together to assure your success. I am full-time available for your offers. Especially for urgent needs since I am very flexible in working hours. Feel free to message me with any questions.ScrapyPostgreSQLTypeScriptHerokuNode.jsGitHubWeb CrawlingData ExtractionData ScrapingPython - $25 hourly
- 5.0/5
- (8 jobs)
Masters in computer science have 5+ years of experience working with clients based in the Uk, USA, Malaysia, and Singapore. Have hand-on experience in python, Django, and flask. Have experience of building an enterprise web application using a web server and microservices-based architecture. Following is the list of the skills I have: Natural Language Processing (NLP) Machine Learning (ML) Computer Vision (CV) Deep Learning (DL) Artificial Intelligence Transfer Learning Python Django Flask Cherrpy Docker Git Workflow Automation Information Extraction from Document (pdf, docx, scanned, xlsx, csv and images) OCR Project ManagementScrapyArtificial IntelligenceBeautiful SoupData ScrapingRESTful APIDjangoAPIArtificial Neural NetworkFlaskMachine LearningpandasNatural Language ProcessingPythonDeep Learning - $50 hourly
- 0.0/5
- (0 jobs)
I have designed and implemented a lot of custom made solutions to scrape and crawl targeted sources, and automate tasks by creating bots. The solutions extend can vary from a basic script to a very advanced complex setup to succeed in the work. My skill sets: - Expertise in scrapy and selenium - Proficient in DOM manipulation with Xpath, BeautifulSoup4, lxml - Have rich experience in avoiding IP blocking with Proxy server - Have scraped big data on a server like AWS, DigitalOcean - Encode content of websites Hence if you have a scripting/automation task that falls in that stack feel free to contact.ScrapyScripts & UtilitiesWeb CrawlingData ExtractionSeleniumPython - $40 hourly
- 5.0/5
- (2 jobs)
I am a web developer, DevOps engineer with great experience in programming for web and automation app development. Creative, sophisticated, dedicated engineer with imaginative and efficient solutions for large-scale projects. As an expert problem resolver, responsive to client needs and detail-oriented, I have a proven track record of consistently providing high levels of customer satisfaction. High quality and clean code is my primary concern. 🛠️ Frontend: - React.js | React Native | Redux - Vue.js | Vuex | Nuxt.js - Karma | Jasmine | Jest - Webpack | Babel | Gulp - Ant Design | Material Design | LESS | SASS 🛠️ Backend: - Python | Django - Ruby on Rails - Node.js | Express - Php | Lavavel | Wordpress | Shopify - Scrapy | Selenium | Beautiful Soap | Lxml - ReportLab | PyPDF | PyDoc | Formulas 🛠️ DevOps: - Docker | Docker Swarm | Kubernetes - Github Actions | Bitbucket Pipelines - Ansible | Jenkins | Octopus Deploy - AWS | Azure | DigitalOcean | Cpanel - CI/CD I am always happy to discuss your project and provide the highest quality of work. Let's work together to set you up for success!ScrapyReactDjangoGatsby.jsNext.jsReact NativeMongoDBTypeScriptJavaScriptPython - $25 hourly
- 4.6/5
- (3 jobs)
Full Stack developers experienced in building custom web applications. Also belongs to developers in one of the top IT solutions company. I deliver high quality solutions and customer satisfaction is our highest priority.ScrapyEcommerce Website DevelopmentMySQLHTMLNode.jsShopifyHTML5CSSWixSpring BootWeb DesignJavaAngularJSBeautiful SoupSQL - $50 hourly
- 0.0/5
- (0 jobs)
Specializes in creating robust APIs and database architectures, focusing on optimizing server-side logic to improve application efficiency. Experienced in developing impactful financial applications and designing scalable, maintainable systems. Emphasizes writing clean code, maintaining a test-driven mindset, and ensuring comprehensive test coverage to guarantee software reliability. Collaborates closely with diverse teams, including product owners, engineering managers, and backend and frontend developers If you'd like to learn more about how my services, please reach out via email or send me a message moein.kameli.mk@gmail.comScrapyXPathSoftware DevelopmentNumPyPostgreSQLRegex WritingRpandasDjangoPythonDockerGitJSON - $35 hourly
- 0.0/5
- (0 jobs)
In the ruby ecosystem, I've worked with StimulusJS, cucumber, new relic, capybara, poltergeist, capybara-webkit, bundler, rubocop, foreman, actionMailer, activeRecord, redis, pq, pry, gitlabhq, redmine, active support, rbenv, rvm, sinatra, stripe, haml, slim, logstash logger, log4r, rubyscript2exe, heroku, thin, unicorn, puma, activeadmin, railroady, paperclip, devise, omniauth, factorygirl, rspec, faker and nokogiri. I have worked on developing scalable front-end applications using React, Redux, Hooks, NextJS and other related technologies. I have a strong understanding of the React library and can develop complex UI components with ease. My proficiency extends to integrating back-end APIs with React applications, as well as working with popular front-end libraries and frameworks like Bootstrap, Material-UI, TailwindCSS and Styled Components. In the Amazon ecosystem, I've worked with ec2, s3, opsworks, beanstalk, route 53, iam and rds. I have worked in Scrum and Kanban Agile environments with a variety of frameworks such as Django, Node.js, and Rails, and have architected databases with both SQL and NoSQL solutions, including MongoDB, MySQL, Oracle, and SQL Server. I am very familiar with common tools such as Git, bash and shell scripting, PowerShell, and ngrok. ────────────────────────────────────── In addition to software development, I offer Tech, Agile, and Executive & Leadership coaching services. I help individuals and organizations enhance their approach to work and team management. The result is increased agility, resilience, effectiveness, and motivation.ScrapyRuby on Rails StackAmazon ECSSaaS DevelopmentTailwind CSSAmazon Web ServicesAPI IntegrationWeb ApplicationDjangoJavaScriptRedisPythonGitReactRuby on Rails - $35 hourly
- 0.0/5
- (0 jobs)
In the ruby ecosystem, I've worked with StimulusJS, cucumber, new relic, capybara, poltergeist, capybara-webkit, bundler, rubocop, foreman, actionMailer, activeRecord, redis, pq, pry, gitlabhq, redmine, active support, rbenv, rvm, sinatra, stripe, haml, slim, logstash logger, log4r, rubyscript2exe, heroku, thin, unicorn, puma, activeadmin, railroady, paperclip, devise, omniauth, factorygirl, rspec, faker and nokogiri. I have worked on developing scalable front-end applications using React, Redux, Hooks, NextJS and other related technologies. I have a strong understanding of the React library and can develop complex UI components with ease. My proficiency extends to integrating back-end APIs with React applications, as well as working with popular front-end libraries and frameworks like Bootstrap, Material-UI, TailwindCSS and Styled Components. In the Amazon ecosystem, I've worked with ec2, s3, opsworks, beanstalk, route 53, iam and rds. I have worked in Scrum and Kanban Agile environments with a variety of frameworks such as Django, Node.js, and Rails, and have architected databases with both SQL and NoSQL solutions, including MongoDB, MySQL, Oracle, and SQL Server. I am very familiar with common tools such as Git, bash and shell scripting, PowerShell, and ngrok. ────────────────────────────────────── In addition to software development, I offer Tech, Agile, and Executive & Leadership coaching services. I help individuals and organizations enhance their approach to work and team management. The result is increased agility, resilience, effectiveness, and motivation.ScrapyRuby on Rails StackAmazon ECSSaaS DevelopmentAmazon Web ServicesTailwind CSSAPI IntegrationWeb ApplicationDjangoJavaScriptRedisPythonGitReactRuby on Rails - $35 hourly
- 0.0/5
- (0 jobs)
𝗔𝗿𝗲 𝘆𝗼𝘂 𝘁𝗶𝗿𝗲𝗱 𝗼𝗳 𝘁𝗵𝗲 𝗺𝗮𝗻𝘂𝗮𝗹 𝗴𝗿𝗶𝗻𝗱 𝗼𝗳 𝗰𝗼𝗽𝘆𝗶𝗻𝗴 𝗮𝗻𝗱 𝗽𝗮𝘀𝘁𝗶𝗻𝗴 𝗱𝗮𝘁𝗮? Looking for a Python expert to streamline your processes and keep you ahead in this data-driven world? 𝗟𝗼𝗼𝗸 𝗻𝗼 𝗳𝘂𝗿𝘁𝗵𝗲𝗿! 𝗪𝗲𝗹𝗰𝗼𝗺𝗲! 𝗜'𝗺 𝗧𝗲𝗱, a Web Scraping and Python Automation Expert with over 7 years of experience in Python programming for data-related tasks. 𝗨𝗻𝗱𝗲𝗿𝘀𝘁𝗮𝗻𝗱𝗶𝗻𝗴 𝘁𝗵𝗲 𝘀𝗶𝗴𝗻𝗶𝗳𝗶𝗰𝗮𝗻𝗰𝗲 𝗼𝗳 data extraction in Data Science, 𝙸'𝚖 𝚑𝚎𝚛𝚎 𝚝𝚘 𝚖𝚊𝚔𝚎 𝚢𝚘𝚞𝚛 𝚕𝚒𝚏𝚎 𝚜𝚒𝚖𝚙𝚕𝚎𝚛. 𝗪𝗛𝗔𝗧 𝗜 𝗖𝗔𝗡 𝗗𝗢 𝗙𝗢𝗥 𝗬𝗢𝗨: ✔ Web scraping for nearly all websites ✔ Scraping even from login-protected websites ✔ Handling endless scrolling data ✔ Extracting data from APIs ✔ Web Automation Tasks ✔ Building Automation Bots for Social media and Websites ✔ Automating Social Media activities (Post, Like, Comment) 𝗬𝗢𝗨 𝗡𝗘𝗘𝗗 𝗠𝗘 𝗜𝗙: ✔ You prefer working smart, not hard. ✔ You want to reclaim your time for family activities. ✔ Your data needs cleaning and organization 𝗕𝗘𝗡𝗘𝗙𝗜𝗧𝗦 𝗢𝗙 𝗪𝗢𝗥𝗞𝗜𝗡𝗚 𝗪𝗜𝗧𝗛 𝗠𝗘: ✔ Unmatched Commitment: Your project is my priority! ✔ Reliability: You can count on me every step of the way. ✔ Open Communication: Quick responses, always! ✔ Clean Code: Maintainable and efficient solutions. ✔ Task-Specific Solutions: Tailored strategies for your needs. ✔ Automation Expertise: From web scraping to automating social media activities, I’ve got you covered. 𝗪𝗵𝘆 𝗰𝗵𝗼𝗼𝘀𝗲 𝗺𝗲? - Programming Languages: Python - Web Development: Django, Flask, HTML, CSS, JavaScript - Web Scraping: BeautifulSoup, Scrapy, Selenium, Playwright - Chatbot Development: Dialogflow, Rasa, Microsoft Bot Framework - Natural Language Processing (NLP): NLTK, SpaCy, GPT - API Development: RESTful APIs, Django REST Framework, Flask RESTful - Database Management: PostgreSQL, MySQL, SQLite, MongoDB - Version Control: Git, GitHub As a developer, I prioritize effective communication throughout every stage of a project. I value transparency and collaboration, striving to maintain an open dialogue with clients to ensure that their vision is realized. Thank you for considering me, and I look forward to the opportunity to contribute to your project's success. Best regards, TedScrapyComputer VisionArtificial IntelligenceChatbotGPT-4oAutomationWeb ScrapingData ScrapingPython - $25 hourly
- 5.0/5
- (9 jobs)
Hello there! 👋 As a wise friend once said, “I wake up every day to create cool stuff with code.” 🚀 This mantra inspires me every day to help you achieve your GOALS in your project. With a solid background in Python programming, I've developed a range of applications from web apps using Django, to web crawlers with Scrapy and requests, not to mention algorithmic programs to solve diverse problems. 🐍 I’m proud to say that my partner, Ali Sina, has a keen eye for front-end development. He uses HTML, CSS, Tailwind, and JavaScript to craft beautiful web pages and custom websites for the ultimate user experience. With the power of React and Next.js frameworks, he brings web pages to life, ensuring a smooth and engaging user experience. 🎨 Our team designs robust APIs with toolkits such as Django REST framework (DRF) and Fast API, along with third-party libraries to ensure solid and sustainable communication with other programs and software. 📡 In web development, we leverage our Object-Oriented Programming (OOP) skills to carefully map Object Relations (ORM) in various databases such as PostgreSQL, MongoDB, and MySQL. 🗃️ Client satisfaction and user comfort are our top priorities; we always test our code to ensure everything meets the highest standards and exceeds client expectations. 🎯 One important lesson we've learned from computers is that punctuality is key to success. They do exactly what they're told to do at the exact time you need them to do it! But we go a step further by adding our creative minds to introduce amazingly interesting features — something computers can't do! 💡 Our technical skills as a team include: — Python Backend Developer (Django, DRF) 🐍 — PHP Backend Developer (PHP, Laravel) — Golang Developer — API Developer (RESTful API, Fast API, Swagger) 🌐 — Database Design (SQL, MYSQL, PostgreSQL, MongoDB) 🗄️ — UI Design (Figma) 🎨 — Front-End Developer (HTML, CSS, JavaScript, React, Next.js) 🖥️ — Multi-Platform (Docker) 🚀 — Version Control (Git, GitHub) 🔄 Embodying the principle that “since two heads work better than one,” we are a dynamic duo of full-stack developers committed to delivering high-standard quality work at a reasonable price. 🪙 We're not just developers; we're problem solvers dedicated to delivering value through our technical skills and innovative approach. We look forward to bringing our full-stack development expertise to your team and driving your success story. 🏆ScrapyReactObject-Oriented ProgrammingDatabaseWeb APIWeb DevelopmentCSS 3HTML5Front-End DevelopmentBack-End DevelopmentWeb CrawlerDjangoPython ScriptPython - $40 hourly
- 0.0/5
- (0 jobs)
Hi, I am Gerald based on Toronto, Canada. I scrape data to add value to your business through data scraping, data extraction, and web scraping solutions. I'm a Web & Data Scraper and Python Automation Expert with over 6 years of experience in Python programming for data-related tasks. If you're on the hunt for a data virtuoso to scrape and extract valuable insights for your business, through different web scraping solution for any data, please choose ME. With over 6 year of hands-on experience in the field, I specialize in leveraging powerful tools like Selenium, BeautifulSoup, and Requests to create efficient web scraping solutions that meet your unique needs. My goal is to help you automate repetitive tasks and extract valuable data seamlessly, allowing you to focus on what truly matters—growing your business. What I Do: I do scraping deep into the digital world to extract precious data gems for your business. From scraping intricate websites to increasing sales for your business, I've got your data scraping needs covered. WHAT I CAN DO FOR YOU: ✔ Web scraping for nearly all websites ✔ Scraping even from login-protected websites ✔ Handling endless scrolling data ✔ Data Extraction from APIs ✔ Web Automation Tasks ✔ Building Automation Bots for Social media and Websites ✔ Automating Social Media activities (Post, Like, Comment) THE SERVICES THAT I'M OFFERING ARE: ☑ Data Extraction ☑ Data scraping ☑ Web Scraping ☑ Website Scraping ☑ Screen Scraping ☑ Directories scraping ☑ Emails Scraping ☑ Bulk Data scraping ☑ OpenAI API ☑ ChatGPT TECHNICAL SKILLS: - Programming Languages : Python - Web Development : Django, Flask, JavaScript, TypeScript, HTML, CSS - Web Scraping : Selenium, BeautifulSoup, Requests, Cheerio, Puppeteer, Playwright, Scrapy - Natural Language Processing (NLP) : NLTK, SpaCy, GPT - Data Handling: Pandas, NumPy - Automation Tools: Selenium WebDriver, Cron Jobs - Artificial Intelligence (AI) : OpenAI, ChatGPT, RAG, LLM - APIs: RESTful API integration, OpenAI API, ChatGPT API Integration, FastAPI - Database Management : PostgreSQL, MySQL, SQLite, MongoDB - Data Formats: JSON, CSV, XML - Version Control: Git, GitHub My expertise lies in developing scalable and efficient scraping solutions tailored to meet specific business requirements. I am passionate about staying up-to-date with the latest web scraping trends and best practices, ensuring my solutions are reliable and compliant with legal and ethical standards. If you are looking for a reliable, experienced, and talented web scraping engineer, I will be here for you.ScrapyChatGPTAPI IntegrationArtificial IntelligenceSeleniumLead GenerationScraper SitePythonData MiningData CollectionWeb Scraping FrameworkWeb Scraping PluginWeb ScrapingData ExtractionData Scraping - $40 hourly
- 0.0/5
- (0 jobs)
If you need data for: ✅ Market research & analysis ✅ Lead generation ✅ Financial indicators ✅ Machine learning You're in the right place. + I will scrape data from a website and save to cloud, offline database or Excel/CSV + I use Python(Scrapy, BeautifulSoup, requests, lxml, Selenium, Regex, Pandas) to scrape data from the website efficiently & reliably. + I can create a Python program/script to automate repetitive annoying tasks. I work with: - Python - Selenium, Scrapy - Regex - HTML, CSS, Wordpress, Bootstrap - MySQL, SQLite, MS AccessScrapyWeb CrawlingNode.jsLead GenerationData MiningRubyPythonPHPData Extraction - $40 hourly
- 0.0/5
- (0 jobs)
I have designed and implemented a lot of custom made solutions to scrape and crawl targeted sources, and automate tasks by creating bots. The solutions extend can vary from a basic script, to very advanced complex setup to succeed the work. My skill sets: - Expertise in scrapy and selenium - Proficient in DOM manipulation with Xpath, BeautifulSoup4, lxml - Have rich experience in avoiding IP blocking with Proxy server - Have scraped big data on server like AWS, DigitalOcean - Encode content of websites Hence if you have a scripting/automation task that falls in that stack feel free to contact.ScrapyVisual Basic for ApplicationsWeb CrawlingData ScrapingSeleniumData ExtractionPython - $50 hourly
- 0.0/5
- (0 jobs)
I have designed and implemented a lot of custom made solutions to scrape and crawl targeted sources, and automate tasks by creating bots. The solutions extend can vary from a basic script, to very advanced complex setup to succeed the work. My skill sets: - Expertise in scrapy and selenium - Proficient in DOM manipulation with Xpath, BeautifulSoup4, lxml - Have rich experience in avoiding IP blocking with Proxy server - Have scraped big data on server like AWS, DigitalOcean - Encode content of websites Hence if you have a scripting/automation task that falls in that stack feel free to contact.ScrapyWeb CrawlingData ScrapingSeleniumPython-RequestsAPI IntegrationBeautiful SouppandasETL Pipeline - $50 hourly
- 0.0/5
- (0 jobs)
I have designed and implemented a lot of custom made solutions to scrape and crawl targeted sources, and automate tasks by creating bots. The solutions extend can vary from a basic script to a very advanced complex setup to succeed in the work. My skill sets: - Expertise in scrapy and selenium - Proficient in DOM manipulation with Xpath, BeautifulSoup4, lxml - Have rich experience in avoiding IP blocking with Proxy server - Have scraped big data on a server like AWS, DigitalOcean - Encode content of websites Hence if you have a scripting/automation task that falls in that stack feel free to contact.ScrapyBigQueryPythonBeautiful SoupPython-RequestsSelenium - $35 hourly
- 0.0/5
- (0 jobs)
I am a professional software developer providing web scraping and functional apps in Python and Javascript. 🛠️ Technologies: - Python Scrapy | Splash | Selenium | Beautiful Soap | Lxml - Zapier - PuppeteerJS | CasperJS - PyQt | Npyscreen | Tkinter - Python Pandas | Numpy - ReportLab | PyPDF | PyDoc | Formulas 📝 Experience: - Creating web/console applications to scrape/crawl any websites. - Extracting Data into CSV/Google Sheets, JSON and Google Sheet. - Data Cleaning/Parsing/Manipulation by Xpath, CSS selector and Regex. - Pass reCaptcha by 2Captcha service. - Avoid IP blocking and Bot detecting by Proxy servers. - Email Collection/Validation. - Run scripts periodically by Cron job/Celery/Schedule on remote servers (Ubuntu/Debian/CentOS). - Vast knowledge of various industries that include Sports betting, Travel, Finance, Real Estate, E-commerce, Insurance, Advertisements, Hedge funds, extc. - Generating PDF files and Extracting Data from PDF & Images. - Excel Formulas and calculations - Website Testing and Form Submit Bot. I am looking for building long-term, productive relationships with my clients and co-workers. Thank you.ScrapyScrapeBoxOnline ResearchData ScrapingAPI IntegrationBeautiful SoupSeleniumPythonZapierData Mining - $40 hourly
- 0.0/5
- (0 jobs)
I am a web scraping expert with over 50 projects successfully completed and with experience of 100s of websites scraped with different levels of complexities and developed with different technologies. Scraping tools: - Languages: Python, PHP, Javascript, Ruby - Frameworks/Libraries: Scrapy, Pandas, Requests, Splash, Selenium, Bs4, Nokogiri, Puppeteer - Database: PostgreSQL, MySQL, MongoDB - Web Scraping Tools and Services : import.io, dexi.io, octoparse, Effortless, Captchas(2Captcha and AntiCaptcha Services), Storm Proxy, Crawlera API, etc - Miscellaneous: AWS, Parsehub, Scrapinghub, Regex, XPath I have worked on projects involving scraping, parsing, normalizing and managing large volumes of data, API development, Data Science and Analytics. I can extract data from websites, PDF files, XML documents and many more formats. I can manage multiple scrapers running simultaneously on a server or a local machine. I can provide data in any format the job requires. I am open to a long as well as a short-term project. I have been working on large-scale data extraction projects and assure you I can handle your next big scraping project.ScrapyWeb CrawlingAWS LambdaData ExtractionPostgreSQLNode.jsPython - $35 hourly
- 0.0/5
- (0 jobs)
I am a professional software developer providing web scraping and functional apps in Python and Javascript. 🛠️ Technologies: - Python Scrapy | Splash | Selenium | Beautiful Soap | Lxml - Zapier - PuppeteerJS | CasperJS - PyQt | Npyscreen | Tkinter - Python Pandas | Numpy - ReportLab | PyPDF | PyDoc | Formulas 📝 Experience: - Creating web/console applications to scrape/crawl any websites. - Extracting Data into CSV/Google Sheets, JSON and Google Sheet. - Data Cleaning/Parsing/Manipulation by Xpath, CSS selector and Regex. - Pass reCaptcha by 2Captcha service. - Avoid IP blocking and Bot detecting by Proxy servers. - Email Collection/Validation. - Run scripts periodically by Cron job/Celery/Schedule on remote servers (Ubuntu/Debian/CentOS). - Vast knowledge of various industries that include Sports betting, Travel, Finance, Real Estate, E-commerce, Insurance, Advertisements, Hedge funds, extc. - Generating PDF files and Extracting Data from PDF & Images. - Excel Formulas and calculations - Website Testing and Form Submit Bot. I am looking for building long-term, productive relationships with my clients and co-workers. Thank you.ScrapyScrapeBoxData ScrapingAPI IntegrationPythonZapierData MiningBeautiful SoupSelenium - $40 hourly
- 0.0/5
- (0 jobs)
I am a web scraping expert with over 50 projects successfully completed and with experience of 100s of websites scraped with different levels of complexities and developed with different technologies. Scraping tools: - Languages: Python, PHP, Javascript, Ruby - Frameworks/Libraries: Scrapy, Pandas, Requests, Splash, Selenium, Bs4, Nokogiri, Puppeteer - Database: PostgreSQL, MySQL, MongoDB - Web Scraping Tools and Services : import.io, dexi.io, octoparse, Effortless, Captchas(2Captcha and AntiCaptcha Services), Storm Proxy, Crawlera API, etc - Miscellaneous: AWS, Parsehub, Scrapinghub, Regex, XPath I have worked on projects involving scraping, parsing, normalizing and managing large volumes of data, API development, Data Science and Analytics. I can extract data from websites, PDF files, XML documents and many more formats. I can manage multiple scrapers running simultaneously on a server or a local machine. I can provide data in any format the job requires. I am open to a long as well as a short-term project. I have been working on large-scale data extraction projects and assure you I can handle your next big scraping project.ScrapySeleniumData ScrapingJavaScriptWeb CrawlingAutomationPythonData ExtractionNode.js - $40 hourly
- 0.0/5
- (0 jobs)
Full time scraping consultant specializing in web scraping, crawling, and indexing web pages. Worked on projects that deal with automation and website scraping, crawling, and exporting data to various data formats. Over the years worked with 200+ different individuals/startups/companies and helped them achieve their goals. Here’s what you will get by working with me: * Working only on projects that I can deliver 100% * Ridiculous quality of work * Smart suggestions on increasing results/revenue and decreasing costs * Responsibility for tasks/project I work on * Reliability *️ Short response time *️ Excellent written and verbal English skills *️ Good sense of humor ;) keywords: python, scrapy, selenium, requests, beautifulsoup, mechanize, lxml, urllib2, web scraping, web crawling, automation, bots, scrapers, spidersScrapyAutomationXPathScripts & UtilitiesWeb CrawlingData ScrapingImport.ioPythonBeautiful SoupSelenium Want to browse more freelancers?
Sign up
How hiring on Upwork works
1. Post a job
Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.
2. Talent comes to you
Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.
3. Collaborate easily
Use Upwork to chat or video call, share files, and track project progress right from the app.
4. Payment simplified
Receive invoices and make payments through Upwork. Only pay for work you authorize.