Hire the best Scrapy Developers in Spain
Check out Scrapy Developers in Spain with the skills you need for your next job.
- $45 hourly
- 5.0/5
- (316 jobs)
Python Software Developer and Data Engineer with 20+ years of experience building data processing solutions, web applications, and expertise in software engineering, data processing, DevOps, and web development. Skilled in Python, Django, Scrapy, Flask, Twisted, FastAPI, MySQL, Redis, MongoDB, Kubernetes, Docker, Azure, GCP, and Gitlab CI. Strong ability to understand business problems and deliver effective solutions. Skills: * Programming: Python, Django, Scrapy, Flask, Twisted, FastAPI, Javascript, SQL * Data: MySQL, Redis, MongoDB, RabbitMQ, Celery, Numpy, Pandas, Zyte * DevOps: Kubernetes, Docker, Azure, GCP, Helm, Nginx * CI/CD: Azure, Gitlab CI Experience: * 20+ years of experience in software development, data processing, and web development * Expertise in software engineering, data processing engineering, DevOps, and web development * Proven ability to work independently and as part of a team to deliver effective solutions * Strong focus on understanding business problems and delivering desired outcomesScrapy
KubernetesDockerFlaskAzure DevOpsPython AsyncioCI/CDWeb DevelopmentDjangoXPathWeb CrawlingWeb ScrapingData ScrapingETL PipelinePython - $35 hourly
- 5.0/5
- (20 jobs)
Hello there! Are you looking for some help in extracting text or images from specific webpages? Or maybe you are trying to compile and organize your data better? Through the magic of web scraping, I help companies transform large, complex and unstructured webpages into structures that are user-friendly and more importantly, usable! As a web scraping expert, I have built a deep history of 10+ successful client projects over the last year. Having helped clients harvest data and images from dozens of sites, some of my project experience is as follows: ✅ Gathering information from online directories ✅ Compiling user reviews of movies from IMdb ✅ Extracting product information from online catalogs (Netflix, HBO, Amazon Prime, Disney) ✅ Sourcing product lists based on specified criteria ✅ Gathering of data to consolidate lists of available storage real estate in a specified geography ✅ PowerBI reporting to help clients make informed, cutting-edge decisions From a toolkit standpoint, I seek to improve and adapt my skillsets continuously to deliver best-in-class outcomes to clients each time. Some of the software programs I am proficient with include: 💻 Web Scraping: Python, Scrapy, Selenium, Splash, BeautifoulSoup, SQL 💻 Data Analysis: SQL, BigQuery, PowerBI, Fivetran, Amplitude In the past, clients have chosen me as their trusted partner for a number of reasons, including: ♦️ Cost-effective with guaranteed quality ♦️ Comfort with both data extraction and data manipulation ♦️ Sharp attention to detail ♦️ Getting it right the first time ♦️ Able to take on the most complex projects ♦️ Proactive suggestions to help you grow revenue and/or reduce cost What you can expect: 🕑I am able to meet tight deadlines, and can offer turnarounds of <24 hours ⭐Exceptional work quality free of errors 💲 Fixed price contracts with no charge for edits requested by clients Send me a message, and I’d love to get started! Regards, AlejandroScrapy
Python ScriptData ScienceScripts & UtilitiesAutomationWeb CrawlingData ScrapingBeautiful SoupData ExtractionPythonSeleniumpandas - $60 hourly
- 5.0/5
- (15 jobs)
I have worked on real-time projects in diverse business domains. Python developer focused on web scraping and data analysis using requests, Selenium, BeautifulSoup, Scrapy, Pandas, Numpy, Matplotlib & seaborn . Good knowledge of machine learning models, GPT-3, ChatGPT, and OpenAI. Top Rated on UpWork. My projects include collecting data from various sources and creating comprehensive analytics that businesses use to make informed decisions. I create charts and dashboards that enable companies to process data quickly and effectively. I have worked with search results (Google, Bing, Elastic search) and social media (Twitter, Instagram, YouTube, TikTok, and others).Scrapy
CSSHTMLLinuxData LabelingMySQLDjangoData AnnotationData VisualizationSeleniumBeautiful SoupPythonpandasData ScrapingSQL - $40 hourly
- 5.0/5
- (97 jobs)
A few of my completed projects: - competitor monitoring agents - price monitoring agents - websites aggregators - data sets collectors (real estate, lawyers, doctors, products, articles and etc. - full-stack solutions - cloud-based web scrapers - servers for web scrapers - anti-bot systems bypassing - real users emulations - social media scraping - lead collectors - stocks monitor agents - eCommerce scrapers - ETL pipelines ... and etc. Please contact me about how I might be able to help you with a project.Scrapy
RESTful APIData ManagementDjangoETL PipelineBot DevelopmentData ScrapingWeb CrawlingSeleniumScriptingAutomationData MiningPython - $30 hourly
- 5.0/5
- (17 jobs)
Hello! I am a highly skilled Python Developer and Data Scientist with over 10 years of experience in IT technologies. I hold a degree in IT security from Aerospace University and have a deep interest in Machine Learning, Data Science, NLP, AI, and Neural Networks. My services include: - Python programming and Pandas work - Data conversion (Excel to CSV, PDF to Excel, CSV to Excel, Audio) - Data mining and extraction - ETL data transformation and cleansing - OCR (Optical Character Recognition using Tesseract) - Building machine learning models - React and JavaScript development with Solidity/Web3 backend - Scrapy web scraping I have a little experience in React and JavaScript development with Solidity/Web3 backend. I am dedicated to providing excellent service and am always available for support after the release of a product.Scrapy
Web CrawlingWeb ScrapingTelegram APIReactPython ScriptData EngineeringSeleniumPythonPython Scikit-LearnData ScrapingData Sciencepandas - $20 hourly
- 5.0/5
- (5 jobs)
I'm a data engineer passionate about leveraging technology to extract insights from complex datasets, specializing in data modeling, ETL processes, and optimizing data pipelines for scalability and efficiency. With a strong foundation in programming and database management, I thrive in environments where I can innovate solutions to drive data-driven decision-making.Scrapy
APIpandasPySparkETLData EntryPython ScriptMachine LearningOffice DesignMongoDBMySQLPythonData ExtractionData Mining - $16 hourly
- 5.0/5
- (2 jobs)
My main skills are working precision and quick adaptation to new environments. I can do crawling and scraping with Scrapy, Requests, Aiohttp, Selenium, BeautifulSoup and pandas to make Excel sheets, json documents, csv and databases. I am junior web developer and I can make also Django web projects, setting up the vps, the server and everything else. I can use also Django-rest-framework to make RESTApi's. I can make the HTML, CSS and Javascript from cero or using Bootstrap and Tailwind. I have also the basics of React and React-Native if needed. I am a hard and reliable worker and I think I can do small programming tasks like fixing python code with no problem. I love the honestity so I fill with terms always. I like philosophy and history, I have two and a half years of law studies and one year of pedagogy, some knowledge on economics and I like all kind of knowledge and technologies.Scrapy
SeleniumWeb ScrapingCybersecurity ToolREST APIJavaScriptHTML5CSSDjangoMicrosoft OfficeLinuxPython - $10 hourly
- 5.0/5
- (1 job)
Hi, I'm Pau Palacios, a skilled Python Developer with a strong focus on data scraping and data processing. I’m confident in solving any challenge efficiently and delivering robust, reliable solutions. Connect with me: Instagram/YouTube @palaus.devScrapy
Beautiful SoupJavaScript.NET CoreJavaSeleniumWeb ScrapingPython - $40 hourly
- 3.3/5
- (111 jobs)
I'm expert in automated Data Extraction and Data Storage / Delivery solutions. I like to collect, process and return Data and have 5+ years of experience in it. — Web scraping Such frameworks as Scrapy, Grab or Selenium helps to collect data from any website. Scrapy is my favorite framework. I have created 100+ spiders using different techniques: proxies, specific headers and website endpoints, APK reverse engineering. Captcha is not a wall for me also. Data could be saved to CSV, JSON, XML, Excel files or database like MongoDB, MySQL, PostgreSQL. — Automation I have created much scripts for job automation like parsing files, data pipelines, connection to third party APIs. — API Flask helps to create lightweight REST APIs to return data. I have used NGINX and uWSGI for deployment on client's servers. I'm very familiar with Amazon Web Services too: EC2, S3, Lambda, DynamoDB, etc. I can convert your legacy Perl to modern Python code also. If your needs are not listed above feel free to contact me and we can discuss them. I believe my strong points as Top Rated developer are Responsibility and Punctuality. My #1 goal will be to meet your needs and deadline always. I'm honest and fair. List of my relevant skills: — Python — Web Scraping / Crawling (Scrapy, Xpath, Grab, Selenium, lxml, regex, Beautiful Soup, TOR, Captcha solving, reverse engineering) — Database (MongoDB, MySQL, MS SQL, MariaDB, PostgreSQL, Oracle) — API (Flask, Flask-RESTful, NGINX, uWSGI) — HTML/CSS/JavaScript/JSON/XML — VCS: Git (Github, bitbucket, GitLab), SVN — Docker — OS: Windows, Mac OS X, Unix — PerlScrapy
Data EntrySQLFlaskAPIData ScrapingWeb CrawlingPythonData Mining - $23 hourly
- 4.7/5
- (448 jobs)
I am a web scraping professional specializing in crafting efficient and reliable web scraping solutions using advanced Python scripting and automation techniques (websites scraping, crawling & indexing) With 7 years of experience on Upwork, over 400 jobs and more than 3500 hours, I have worked on numerous projects in automation, web scraping, crawling and data exportation in several formats for around 250 clients. To handle complex web scraping tasks, I develop hybrid solutions using Scrapy and Selenium which allows me to scrape dynamic or JavaScript-heavy websites efficiently, with Selenium for rendering and Scrapy for data extraction, depending on the volume of data to optimize speed. For static sites, I rely solely on Scrapy for faster scraping, while in cases requiring full browser interaction, I use only Selenium. I am able to deal with hidden APIs, rotating residential proxies and captchas (using a service such as 2captcha and integrating their API in my code) Throughout my career, I have successfully scraped around 1000 sites spanning various categories such as e-commerce websites, job boards, corporate websites, government websites, community forums, etc My services stack is: - Scraping sites protected or not - Scraping images and structuring them in folder and sub-folders if needed - Doing some automation to automated boring tasks I use the following technologies: - Languages: Python - Visual Basic .NET - C# - Integrated Development Environment (IDE): Visual Studio Code - Pycharm - Visual Studio - Scraping Frameworks: Scrapy - Connection: requests - urllib - urllib3 - webrequest - httpwebrequest - webclient - httpclient - webbrowser - webkitbrowser - geckobrowser - Automation tools (headless browsers): Selenium - SeleniumWire - SeleniumBase - Undetected_chromedriver - playwright - Extractors: Beautiful soup (bs4), lxml - Extracting techniques: xpath - css selectors - string processing - json - regular expressions - Input / Output formats: CSV - Excel - MySQL - PostgreSQL - JSON - XML - Data manipulation, File output, Tables: Pandas The kinds of projects I can create are: Pure solution for static sites: - Requests + Beautiful Soup (bs4) - Requests + Lxml - Scrapy (get requests / post request) Pure solution for dynamic sites: - Selenium / SeleniumWire / SeleniumBase / Undetected ChromeDriver (sometimes used with Beautiful Soup (bs4) or Lxml in case of large tables where pandas is not enough) hybrid solutions for half dynamic sites: - Selenium-Scrapy: dynamic for crawling, static for scraping - Scrapy-Selenium: static for crawling, static for scraping It sounds great but why should you choose me over another freelancer? because according to my clients, I do have the following skills: I am a talented and skilled freelancer dedicated to crawling & scraping: smart, fast and efficient, reliable and professional, detail oriented with problem-solving skills/mindset and a positive attitude. Proactive, straight to the point, honest and trustworthy, I am very easy to work with, friendly, cooperative and a good team player that will give you high quality deliverables (very clean data) Hard worker and willing to go the extra mile I need a perfect understanding of the task to perform (I ask as many questions as necessary if some specifications are unclear) Responsive and transparent, good communicator and passionate about what I do, I am always eager to learn new techniques and technologies: stubborn and never giving up, I always give my clients a sample before the big extraction when necessary to be absolutely sure it is the way you want it. Too many qualities for the same freelancer you will say? I would say exactly the same but I have no choice but recognize those qualities because they all come from my clients feedback: you can verify it in my profile but be aware you will have to paginate through 42 pages :-( :-) Finally I will say this: happy client, happy freelancer and I want to be happy so I have to make you happy first, I have no choice! Here are a few feedback: "We recently had the pleasure of working with Eric on a project, and we couldn't be happier with the results. Eric's attention to detail, problem-solving skills, and positive attitude set him apart. If you're looking for a dedicated and talented freelancer, Eric is your go-to person. Looking forward to more successful collaborations” "Eric is an amazing Upworker, very easy to communicate with, super fast and efficient, a top notch, he comes highly recommended for any data scraping job."Scrapy
AJAXJSONCSVXLSXMicrosoft AccessPostgreSQLMySQLXPathBeautiful SoupSeleniumBot DevelopmentAutomationData MiningWeb Scraping - $5 hourly
- 5.0/5
- (1 job)
Greetings! I'm a passionate Python engineer excited to join forces with you on your projects. I take pride in my meticulous attention to detail, knack for clean code, and excellent organizational skills. What I Bring: Problem Resolver: I made over 100 projects and I resolved a lot of issues in the way, I know how to fix and avoid errors to make your code protected. Code Craftsmanship: I believe in writing code that's as elegant as it is effective. Eager Learner: With an insatiable curiosity, I'm always ready to dive into new challenges. Backend Excellence: I'm committed to continuous growth and excellence as a Backend Developer. Let's team up and turn your ideas into reality. I'm motivated, dedicated, and ready to contribute my skills to your success. Ready to collaborate? Skills: ✅ Python, JS ✅ Django, FastAPI, Flask. ✅ SQL, SQLite, NoSQL. ✅ JSON, APIs. ✅ Testing, Debug. ✅ BS4, Selenium, Scrapy.Scrapy
Beautiful SoupSeleniumTestingPostmanJSONunittestNoSQL DatabaseFastAPIPython-RequestsMongoDBAPISQLiteFlaskPython - $15 hourly
- 0.0/5
- (0 jobs)
I’m a seasoned developer experienced in web scraping and data extraction using Python. Whether you need to collect data for analysis, generate leads, automate workflows, or build a custom scraping solution, I can help. Proficient in tools and libraries like BeautifulSoup, Scrapy, AIOHTTP, Asuncion, Selenium, Pandas, and requests. I deliver full, reliable code and provide data in useful formats (JSON, CSV, XML, Databases...) Expert in designing efficient and scalable scraping pipelines Full project management from concept to deployment Regular communication is important to me, so let’s keep in touchScrapy
Tailwind CSSNext.jsReact NativeReactMySQLElasticsearchMongoDBScriptingScriptAIOHTTPFastAPISeleniumPython AsyncioPython - $25 hourly
- 0.0/5
- (4 jobs)
I'm software engineer with 4 years of experience in backend development. I am currently working and living in Madrid. I am motivated and communicative person and I have sense of responsibility and team work. I like new challenges. Programming languages: - Python - Node Frameworks - Django / Flask - Express.js / Sails.js Databases: - MySql, PostgreSQL, Mongo - Redis Technnologies I have used: - Scrapy, BeautifulSoup and Selenium for web scrapping. - Websocket - Docker - NiFi - RDF - SPARQL - Apache Jena Fuseki - Heroku - AWS services like: ec2, S3, cloudfrontScrapy
Apache NiFiBeautiful SoupSeleniumFlaskDjangoPython - $50 hourly
- 0.0/5
- (0 jobs)
I have 10+ years of experience in webdev, of which last five are in Full Stack development. Actually, I am language agnostic, which means that language by itself is not very significant for me -- they are all the same; but platform, paradigm and typical architecture of language specific solutions could make the difference. On the one hand, I am very interested in building application architectures, developing theme and solving the business tasks with use of technology rather than making the thing just for making them. On the other hand, I like to create some experimental applications for fun if I see a problem (business or real-life) to be solved, and usually these applications spill over into lot of coding with new technologies and techniques. ✔ Framework: Django, Laravel, Codeigniter, YII etc ✔ Language: Python, PHP ✔ Scripting: JavaScript, AngularJS, NodeJS, ReactJS, VueJS, D3JS etc ✔ BlockChain - Ethereum, BSC, IoTeX. ✔ Stack - Solidity, Truffle, Ganache, Geth, ReactJS, NodeJS, Blazor, Python. ✔ Tokens - ERC20, ERC721,... ✔ Dapps - Metamask (web3), other by json rpc I do my job very attentively to details and client requirements. If there are some moments which will require to learn something unknown for me in this system I will do it without charging you.Scrapy
React NativeShopifyBlockchain ArchitectureMobile Appweb3.jsAWS LambdaWordPressReactNode.jsDjangoWeb ApplicationPythonLaravelVue.js Want to browse more freelancers?
Sign up
How hiring on Upwork works
1. Post a job
Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.
2. Talent comes to you
Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.
3. Collaborate easily
Use Upwork to chat or video call, share files, and track project progress right from the app.
4. Payment simplified
Receive invoices and make payments through Upwork. Only pay for work you authorize.