Upwork home
Sign Up
Secondary
Ruediger S.

Ruediger S.

Dresden, Germany
Job Success
Top Rated

"This guy rocks" - Web Scraping | Crawling | Scrapy | XPath | NLP

A true story: Their project was dead. Thousands of dollars sunk into a system that barely worked. Hidden gaps in the data popping up everywhere. Upset partners. Angry clients. And their CEO ready to “pull the plug” on their startup after another VC pitch was botched by demoing with incomplete and low quality data. Several other scraping experts (including two former G***le data scientists) had attempted to solve the problems and failed. They were truly frustrated. In a last ditch effort to salvage their startup they shared the complete story with me. Drawing on my 15+ years experience I put their system into a high stress test environment. Ferreted out all the errors. Plugged all holes where their system was leaking data. And filled the gaps in the existing data to get it ready for the next demo ... The result? Two exhausting weeks later success was back. VC’s impressed by a demo with complete data. Clients delighted by the latest update. And the CEO asking me to become their new CTO. Well, good for me I didn’t accept her offer. I’m too much in love with being a freelancer. Good for you, too. As I’m now here to help you. I truly hope you are far from a similar situation, so contact me to make sure you really are. And let me prove that I am more than just a firefighter. At the end of it all you, too, may end up posting such a “this guy rocks” review. I can’t solve every problem. Some challenges in certain projects are just too great to overcome. And while I sometimes can do the impossible, I would rather be known for taking care of all my clients from the beginning to the end of the project, providing a smooth and painless project experience that many call the absolute best experience in working with freelancers they have ever had. Like this guy: "Lots of people wrote "this guy rocks". And that is simply true. Ruediger is extremely smart and clear and the quality is extraordinary." - a Client @upwork That's why I can guarantee results: you are satisfied or you pay nothing. Period. What I can do for you: 1. Scraping unstructured data from websites, online directories, web archives etc for Research and Data Acquisition 2. Building systems for market intelligence that scan websites continuously for changes in price, product listings, etc … in almost any market imaginable (I’ve seen and built such projects for retailers, in real estate, building equipment and some more) 3. Extracting data for Lead Enrichment and Lead Generation - improve your marketing efforts with data that’s available on the web 4. Anything else data and web automation related that comes to your mind – invite me to your project and we can discuss what can be done. You need me, if: - the data source is difficult to scrape and others have failed already - you have complex data that needs intense restructuring and cleanup - you need the data prepared and imported into database structures ranging from MySQL to complex Hadoop or Spark clusters - the data is highly unstructured and requires the use of NLP (Natural Language Processing) and Deep Learning algorithms for cleanup and restructuring Your benefits of working with me: 1. Things will run smoothly like on autopilot. You won’t get another employee-like guy who needs babysitting, micromanagement and has to be pushed to work. 2. Open communication: you will receive project updates from me at least once a week, if necessary even daily. In the rare cases when problems come up I will tell you openly and you'll never see me disappear (I'm still astounded that this is a common problem with other freelancers) 3. Quick turnaround times and reliable, complete and accurate results ensured by me using Python and the scrapy framework (that's my strong recommendation if technology can be choosen freely) plus building everything in a test driven way (I’m the author of the scrapy_tdd testing library) 4. There's little that can stop me: anti scraping mechanisms (captchas, bandwidth throttling, IP banning) are easily overcome using a network of 3000+ proxy servers, the tor network plus my lateral thinking and well grounded education in computer science 5. Messy or strangely coded data is no problem as I'll clean it using my data mining experience plus OCR automation to handle data that's hidden in images (like emails in many business directories) 6. Top Secret: If required, I'll stay stealthy while scraping for you using my network of proxies or the infamous Tor network - as a result your scraping project won't ring your competitions' alarm bells and won't give away what your plans are Or to put it into a shorter version: “Ruediger has performed an outstanding job for us. He demonstrates a great deal of professionalism and technical excellence. I strongly endorse him without reservation!” - a Client @upwork So don’t wait to contact me. Invite me today and you might be posting such a happily raving review in a few weeks, too.
Rating is 5 out of 5.
5.00 Oct 27, 2022 - Feb 21, 2023

"Ruediger did an excellent job with the work I needed! Will definitely hire again."

Private earnings
Rating is 5 out of 5.
5.00 Jun 23, 2016 - Dec 20, 2022

"One of the best freelancer I've ever worked with."

Private earnings
Rating is 5 out of 5.
5.00 Mar 9, 2018 - Sep 9, 2022
Private earnings
Rating is 5 out of 5.
5.00 Apr 8, 2020 - May 22, 2022
Private earnings
Rating is 5 out of 5.
5.00 Mar 26, 2021 - Dec 3, 2021

"No more wishes, great job - will work with Rüdiger again! :)"

Private earnings
Jan 12, 2021 - Apr 29, 2021

No feedback given

Private earnings
Rating is 5 out of 5.
5.00 Apr 29, 2019 - Jun 5, 2020

"Great job, thanks!"

Private earnings
Rating is 5 out of 5.
5.00 Jun 14, 2019 - Jun 26, 2019

"High level of skill, quality of work produced as expected. Availability satisfied my requirements. Maintained the schedule to expectations. Communication excellent - Patient in understanding requirements of scope. Cooperation and helpfulness again excellent. No hesitation in recommending Ruediger."

Private earnings
Mar 9, 2018 - May 1, 2019

No feedback given

Private earnings
Rating is 5 out of 5.
5.00 Nov 9, 2018 - Jan 21, 2019

"Ruediger helped us build a scraper and has done an outstanding job. He asked questions and helped us come up with the best solution for our project. I couldn't recommend him highly enough and look forward to working with him again in the future."

Private earnings
Ruediger S. has more jobs. Create an account to review them

Portfolio

10+ mio scraped articles ...
10+ mio scraped articles ...
Scraper source code
Scraper source code
Want to see more? Create Account

Skills

Get started working with Ruediger quickly with these predefined projects.

Get started working with Ruediger quickly with these predefined projects.

You will get your scraper architecture and technology reviewed

From $90
3 days delivery
Ruediger S.

Ruediger S.

Dresden, Germany
Job Success
Top Rated
237
Total Jobs
849
Total Hours

View profile

"This guy rocks" - Web Scraping | Crawling | Scrapy | XPath | NLP

Specializes in
A true story: Their project was dead. Thousands of dollars sunk into a system that barely worked. Hidden gaps in the data popping up everywhere. Upset partners. Angry clients. And their CEO ready to “pull the plug” on their startup after another VC pitch was botched by demoing with incomplete and low quality data. Several other scraping experts (including two former G***le data scientists) had attempted to solve the problems and failed. They were truly frustrated. In a last ditch effort to salvage their startup they shared the complete story with me. Drawing on my 15+ years experience I put their system into a high stress test environment. Ferreted out all the errors. Plugged all holes where their system was leaking data. And filled the gaps in the existing data to get it ready for the next demo ... The result? Two exhausting weeks later success was back. VC’s impressed by a demo with complete data. Clients delighted by the latest update. And the CEO asking me to become their new CTO. Well, good for me I didn’t accept her offer. I’m too much in love with being a freelancer. Good for you, too. As I’m now here to help you. I truly hope you are far from a similar situation, so contact me to make sure you really are. And let me prove that I am more than just a firefighter. At the end of it all you, too, may end up posting such a “this guy rocks” review. I can’t solve every problem. Some challenges in certain projects are just too great to overcome. And while I sometimes can do the impossible, I would rather be known for taking care of all my clients from the beginning to the end of the project, providing a smooth and painless project experience that many call the absolute best experience in working with freelancers they have ever had. Like this guy: "Lots of people wrote "this guy rocks". And that is simply true. Ruediger is extremely smart and clear and the quality is extraordinary." - a Client @upwork That's why I can guarantee results: you are satisfied or you pay nothing. Period. What I can do for you: 1. Scraping unstructured data from websites, online directories, web archives etc for Research and Data Acquisition 2. Building systems for market intelligence that scan websites continuously for changes in price, product listings, etc … in almost any market imaginable (I’ve seen and built such projects for retailers, in real estate, building equipment and some more) 3. Extracting data for Lead Enrichment and Lead Generation - improve your marketing efforts with data that’s available on the web 4. Anything else data and web automation related that comes to your mind – invite me to your project and we can discuss what can be done. You need me, if: - the data source is difficult to scrape and others have failed already - you have complex data that needs intense restructuring and cleanup - you need the data prepared and imported into database structures ranging from MySQL to complex Hadoop or Spark clusters - the data is highly unstructured and requires the use of NLP (Natural Language Processing) and Deep Learning algorithms for cleanup and restructuring Your benefits of working with me: 1. Things will run smoothly like on autopilot. You won’t get another employee-like guy who needs babysitting, micromanagement and has to be pushed to work. 2. Open communication: you will receive project updates from me at least once a week, if necessary even daily. In the rare cases when problems come up I will tell you openly and you'll never see me disappear (I'm still astounded that this is a common problem with other freelancers) 3. Quick turnaround times and reliable, complete and accurate results ensured by me using Python and the scrapy framework (that's my strong recommendation if technology can be choosen freely) plus building everything in a test driven way (I’m the author of the scrapy_tdd testing library) 4. There's little that can stop me: anti scraping mechanisms (captchas, bandwidth throttling, IP banning) are easily overcome using a network of 3000+ proxy servers, the tor network plus my lateral thinking and well grounded education in computer science 5. Messy or strangely coded data is no problem as I'll clean it using my data mining experience plus OCR automation to handle data that's hidden in images (like emails in many business directories) 6. Top Secret: If required, I'll stay stealthy while scraping for you using my network of proxies or the infamous Tor network - as a result your scraping project won't ring your competitions' alarm bells and won't give away what your plans are Or to put it into a shorter version: “Ruediger has performed an outstanding job for us. He demonstrates a great deal of professionalism and technical excellence. I strongly endorse him without reservation!” - a Client @upwork So don’t wait to contact me. Invite me today and you might be posting such a happily raving review in a few weeks, too.
Rating is 5 out of 5.
5.00 Oct 27, 2022 - Feb 21, 2023

"Ruediger did an excellent job with the work I needed! Will definitely hire again."

Private earnings
Rating is 5 out of 5.
5.00 Jun 23, 2016 - Dec 20, 2022

"One of the best freelancer I've ever worked with."

Private earnings
Rating is 5 out of 5.
5.00 Mar 9, 2018 - Sep 9, 2022
Private earnings
Rating is 5 out of 5.
5.00 Apr 8, 2020 - May 22, 2022
Private earnings
Rating is 5 out of 5.
5.00 Mar 26, 2021 - Dec 3, 2021

"No more wishes, great job - will work with Rüdiger again! :)"

Private earnings
Jan 12, 2021 - Apr 29, 2021

No feedback given

Private earnings
Rating is 5 out of 5.
5.00 Apr 29, 2019 - Jun 5, 2020

"Great job, thanks!"

Private earnings
Rating is 5 out of 5.
5.00 Jun 14, 2019 - Jun 26, 2019

"High level of skill, quality of work produced as expected. Availability satisfied my requirements. Maintained the schedule to expectations. Communication excellent - Patient in understanding requirements of scope. Cooperation and helpfulness again excellent. No hesitation in recommending Ruediger."

Private earnings
Mar 9, 2018 - May 1, 2019

No feedback given

Private earnings
Rating is 5 out of 5.
5.00 Nov 9, 2018 - Jan 21, 2019

"Ruediger helped us build a scraper and has done an outstanding job. He asked questions and helped us come up with the best solution for our project. I couldn't recommend him highly enough and look forward to working with him again in the future."

Private earnings
Ruediger S. has more jobs. Create an account to review them

Portfolio

10+ mio scraped articles ...
10+ mio scraped articles ...
Scraper source code
Scraper source code
Want to see more? Create Account

Skills

Get started working with Ruediger quickly with these predefined projects.

Get started working with Ruediger quickly with these predefined projects.

You will get your scraper architecture and technology reviewed

From $90
3 days delivery
As Needed - Open to Offers

< 24 hrs response time

Browse similar freelancers

Sign up to discuss your project with Ruediger S.