Upwork home
Sign up
Secondary
Yogesh P. Status: Offline
Dubai, United Arab Emirates
100% Job Success

Big Data DevOps Architect | Werb Scraping | Selenium | Automation

🌟 Your Ultimate DevOps and Big Data Maestro 🌟 🔥 **Experience**: With over 10 years of dedicated experience as a Big Data/DevOps Architect, I've mastered the art of weaving technological wonders across the Telecommunications, E-commerce, and Travel sectors. My journey is adorned with 4 AWS certifications and 1 Kubernetes certificate, proving my unwavering commitment to excellence. 🚀 **DevOps Excellence**: You can rely on me for a wide spectrum of DevOps challenges. I'm your go-to expert for automation tasks, including cloud deployments, data scraping, and test automation. I thrive on building and deploying applications and crafting comprehensive big data solutions from the ground up. Additionally, I'm open to providing personalized or corporate training to help you and your team excel. 🌐 **Technology Mastery**: My skill set spans the DevOps landscape. I specialize in implementing CI/CD pipelines using Jenkins, Groovy, and Python. I excel in developing web applications using Apache and Nginx. I'm adept at centralizing logging with the ELK stack, CloudWatch, and custom loggers, as well as centralizing monitoring with the TIG stack, Prometheus, CloudWatch, and custom monitoring tools. I have a knack for configuring security measures and optimizing application performance, leveraging Terraform, CloudFormation, and Ansible. 💡 **Big Data Virtuoso**: My expertise extends to setting up core/customized Hadoop clusters on AWS cloud, extracting and importing data from diverse sources, troubleshooting, cluster maintenance, security, high availability, and performance tuning. 📊 **Data Pioneering**: My data journey includes auditing and reporting of nodes, benchmarking operations, disaster recovery solutions, backup automation, and meticulous documentation of best practices. Root cause analysis is my forte. I provide invaluable operational support in POCs and ongoing administration of existing big data technology stacks. 🎓 **Educational Background**: I'm a strong engineering professional with a Master’s Degree in Computer Science from the International Institute of Information Technology, Bhubaneswar (IIIT-Bhubaneshwar). 🌐 **AWS Proficiency**: My command over AWS services is exemplary, encompassing EC2, ECS, ECR, CodeCommit, VPC, IAM, S3, Redshift, RDS, DocumentDB, Elasticache, Athena, Glue, ElasticBeanstalk, and more. 🔢 **Hadoop Expertise**: In the realm of Hadoop, I'm well-versed in MapReduce MR1/MR2, HDFS, Hive, Nifi, Kafka, Spark, Sqoop, Zookeeper, Hue, AWS, Tableau, Qlik-Sense, PowerBi, and more. 🐍 **Python Sorcery**: Beyond DevOps and Big Data, I'm also a Python virtuoso, orchestrating web scraping symphonies with Scrapy, BeautifulSoup (bs4), and Selenium. My API enchantment transforms disparate data sources into harmonious melodies. 💼 **Web Development Craftsmanship**: Witness the magic of web development as I create captivating user interfaces and dynamic backends that bring your visions to life. 🤖 **Bot Magic**: With a flick of my wand, I conjure intelligent bots that automate tasks, freeing you from the mundane and empowering you to focus on what truly matters. ☁️ **Cloud Enigma**: Step into the cloud, where I unravel the enigma of AWS, utilizing its boundless capabilities to store, process, and scale data beyond imagination. 🧲 **Magnet for Insights**: My skills act as a magnet, attracting invaluable insights hidden within vast data landscapes, illuminating the path to informed decisions and unmatched success. 🎨 **Customization Alchemy**: Every project is a canvas for my customization alchemy. Your needs become my inspiration, and I shape solutions that align perfectly with your aspirations. 🔮 **Data Alchemist Extraordinaire**: Above all, I am a data alchemist, blending expertise, passion, and innovation to forge solutions that enchant, captivate, and redefine possibilities. Dare to dream big and let my enchanting skills cast a spell on your projects. Embrace the magic of data, and together, we'll create a symphony of success that reverberates through time. Thank you for joining me on this extraordinary journey, and I eagerly await the chance to illuminate your path with the brilliance of my skills. Let's weave wonders together! 🔗 **Keywords**: scraping, crawling, automation, scrapy, bs4, selenium, python, AWS, data mining, data extraction, API, Django, Flask, FastAPI, Cloud, MySQL, SQL, Requests, ChatGPT
Work history
Yogesh P. has more jobs. Create an account to review them
Skills

Skills

  • Python
  • Terraform
  • Docker
  • Ansible
  • Kubernetes
  • CI/CD
  • DevOps
  • Apache Hadoop
  • Selenium
  • Apache NiFi
  • Data Lake
  • Amazon S3
  • Web Scraping
  • Selenium WebDriver
  • Automation

Browse similar freelancers