Upwork home
Sign up
Secondary
Umesh K. Status: Offline
Bhaktapur, Nepal
100% Job Success
Rising Talent

Scraping | Automation | AI | Full Stack Dev | React | Typescript

I have helped build a number of sass products and profitable web apps that leverage web automation, NLP and data scraping pipelines. Some of the work that I do: ✅ Automated video generation at scale using Remotion and Runway/Imagen 3/Eleven Labs integration. Unlimited supply of videos with high retention potential for YouTube or TikTok. ✅ data scraping, clean-up and visualization pipelines ✅ Full-stack SASS dashboards and web apps that use scraped data: I have developed all kinds of web apps with Node and React/Next. I have an eye for elegant design and I prioritise security, accessibility, usability and SEO. ✅ browser automation with puppeteer ✅ LLM based question answering and search engines from existing or scraped knowledge base ✅ API automation and bot programming ✅ Scheduled scrape jobs using cron and integration with a wide range of database technologies (MySQL, SQLite, Redis, Neo4j, Algolia, MongoDB) depending on your use case ✅ image to text conversion with OCR using tesseract at a scale ✅ batch processing and manipulation of spreadsheets, texts, pdf documents, images and audio ✅ advanced parsing and manipulation of text - fuzzy pattern matching at a scale ✅ custom NLP pipeline development I can scrape and automate sites: ✅ under cloudflare protection ✅ protected by captcha (2captcha integration) ✅ requiring login and/or 2FA ✅ with dynamic content rendered using javascript ✅ requiring proxies/IP rotation ✅ where pages are hidden, archived or not indexed ✅ having multiple levels of nesting ✅ where data is embedded in maps or charts With the following optimizations, I can scrape at the rate of upto 25 million rows/day: ✅ I have my own lightweight regex based parser for when speed is the priority ✅ I can push Puppeteer to the limits in terms of performance ✅ I can fully leverage node.js parallelism and concurrency to speed up scraping ✅ I can set up multiple synchronized servers for large scale scraping ✅ I have all the software engineering techniques under my belt to manage complex scraping codebases ✅ for large projects, I can interface the scraper with SQL/noSQL databases or cloud storage providers like Google drive ✅ I can reverse engineer the web client API to bypass UI overhead if possible, thereby significantly speeding up the scraper I have won a number of 🥇problem solving competitions🥇, both local and international. My skills and resourcefulness will come in handy while working under time constraints. Most importantly, I strive hard to live up to my clients' expectations.
Work history
Umesh K. has more jobs. Create an account to review them
Skills

Skills

  • Python
  • Data Extraction
  • Data Scraping
  • JavaScript
  • Web Crawling
  • D3.js
  • Scripting
  • Node.js
  • React
  • Data Visualization
  • Automation
  • Regex Writing
  • JSON
  • Data Mining
  • TypeScript

Browse similar freelancers