Upwork home
Sign up
Secondary
Wesley S.
Parnaiba, Brazil

Python developer , Web Scraper, Web Crawling & Data extraction Expert

Graduated in Computer Science from Parnaíba State University, I have extensive experience with Python in Web Development and Data Engineering. Throughout my career as a data engineer, I have constantly sought a strategic vision to positively impact companies through efficient data management. I highlight my ability to capture and integrate large volumes of data, as well as automating processes that previously required significant manual effort. My goal is not only to facilitate, but also to enhance the team experience, contributing to the generation of valuable insights and effectively optimizing operations. Experience in automating tasks on the Web, building Web crawlers, designing an end-to-end data pipeline, from extraction from data sources to delivery to storage systems, platforms using Python, tools such as Selenium, libraries such as Requests, Bs4 and frameworks such as Scrapy and Flask for API creation. In Big Data technologies, data processing and manipulation I have experience with SQL, NoSQL Apache Spark, Apache Airflow, Apache Kafka, Data Lake Architecture, Databricks platform, knowledge of Data Mesh architecture through two courses at Alura: "A distributed approach to data" and "data as products". In terms of cloud computing solutions, I have knowledge and experience of AWS in the following services: Lambda, S3, EC2, ECS, SQS, Cloudwatch.
Wesley S. has more jobs. Create an account to review them

Skills

  • Selenium
  • Scrapy
  • Web Scraping
  • Web Crawler

Browse similar freelancers