Hire the best Big Data Engineers in Sri Lanka
Check out Big Data Engineers in Sri Lanka with the skills you need for your next job.
- $15 hourly
- 4.9/5
- (13 jobs)
Specializing in the development of highly tailored ETL (Extract, Transform, Load) pipelines, I harness the capabilities of Azure Data Factory and Azure Databricks to unlock the full potential of your data, regardless of its original source. With a wealth of experience, I adeptly extract data from diverse origins, including ERP systems, databases, APIs, JSON, XML, and more, spanning across platforms like Microsoft Dynamics, SAP, Oracle, and other ERP systems. My proficiency lies in executing diverse data transformations, ranging from data cleansing, aggregation, and filtering to enrichment. I am skilled in managing Slowly Changing Dimensions (SCD), which is essential for preserving historical data while adapting to changes over time, ensuring the continual relevance and accuracy of your data. Whether you're undertaking a cloud migration, building data lakes, or establishing real-time data processing, I can ensure your data is optimized to meet your business requirements and objectives.Big Data
Data AnalyticsCloud ComputingData ProcessingData LakeVisualizationMicrosoft AzureHibernateSpring BootAzure App ServiceDatabricks PlatformSQLPythonJava - $20 hourly
- 5.0/5
- (18 jobs)
Experienced Software Engineer with a demonstrated history of working in the information technology and services industry. Skilled in Java, Spring Boot, DevOps, Jenkins, Ansible Eureka, React, and groovyBig Data
Apache NiFiDockerLinuxApache Spark MLlibDevOpsAnsibleApache HadoopApache SparkElasticsearchPythonCloud ComputingJavaScriptJava - $10 hourly
- 5.0/5
- (3 jobs)
I am a skilled FPGA Firmware developer plus ASIC flow expert who has more than 10 years of industry experience. I have familiar with Synopsys and Vivado EDA tool flow and has been working on Verilog/SystemVerilog RTL modeling and verification framework development for my entire tenure. Further I have completed an MTech on AI and Data Analytics and I have very good knowledge on Python, TCL and C/C++ programming languages as well.Big Data
Tcl/TkCDeep LearningNeural NetworkMachine LearningArtificial IntelligencePython Scikit-LearnTensorFlowC++PythonSystemVerilogFPGAVerilog - $49 hourly
- 0.0/5
- (0 jobs)
I'm a specialized Computer Vision and AI Engineer offering professional solutions to transform your business challenges into opportunities. With extensive hands-on experience and deep technical expertise, I deliver scalable, production-ready AI solutions. Technical expertise: Computer Vision & AI: YOLOv8, Facenet, BERT, TensorFlow, SpaCy Backend Development: FastAPI, Flask, PHP, Python Frontend Technologies: React, JavaScript, CSS Database Solutions: MySQL, MongoDB, Milvus Vector DB DevOps & Infrastructure: Docker, Git, Linux, Shell Scripting IoT Integration: ESP32, Jetson platforms, MQTT I specialize in: Facial recognition systems Object detection solutions Sentiment analysis implementations Real-time processing systems Anti-spoofing security mechanisms Full-stack AI applications Whether you need a computer vision solution, AI-powered automation, or enterprise-grade detection systems, I bring the technical prowess to turn your requirements into reality. Let's discuss how we can leverage AI to solve your specific challenges.Big Data
Model DeploymentCloud ComputingAPI DevelopmentReinforcement LearningMachine Learning AlgorithmData Analytics & Visualization SoftwareMLOpsYOLONatural Language ProcessingDeep Learning FrameworkData MiningMachine Learning ModelArtificial Intelligence - $35 hourly
- 5.0/5
- (4 jobs)
Seasoned software professional with 9+ years of experience in Financial System design and implementation. Enterprise Application Integration and Integration platforms and practices, building and implementing object-oriented and distributed systems, interacting with customers. Interested in Java back end development and to solve complex challenging financial integration problems.Big Data
Apache JMeterJ2EEMATLABService Cloud DevelopmentMongoDBJavaNode.js - $15 hourly
- 5.0/5
- (3 jobs)
I am Engineer with passion over Quality of the products. I have more than 4 years of experience in the field. I had graduated with BSc degree in Applied Sciences from Wayamba University of Sri Lanka. After graduation I had worked in multinational companies like Virtusa, Wiley and CAMMS. I have Experience in below test types QA Manual Testing API Testing API test Automation UI test Automation ETL/ELT Data Migration testing ETL/ELT Data Migration test automation Performance testing I have experience in below test domains Finance Telecommunication Healthcare Publication Risk Management I have experience in below test tools and technologies Postman Selenium Cypress MS SQL Servers AWS Snowflake I have experience in below Programming languages Python JAVA JavaScript SQLBig Data
Database TestingWeb TestingData ScienceApache AirflowStatisticsManual TestingAPI TestingTestingSoftware QASeleniumPythonpandasSQLETL Pipeline - $14 hourly
- 5.0/5
- (3 jobs)
Hello! I'm Pasindu Perera — a seasoned Machine Learning Engineer with 3+ years of experience. Here's what I bring to your project: ✅ AI/ML & Deep Learning Expertise – Skilled in building ML/DL models using Python, R, TensorFlow, and PyTorch. ✅ Generative AI & LLMs – Experienced in developing solutions using Generative AI, Large Language Models (LLMs), and Transformers. ✅ Chatbot Development – Specialized in building intelligent chatbots with conversational memory, intent handling, and natural flow. ✅ Vector Databases – Proficient in using Pinecone, FAISS, and ChromaDB for semantic search and retrieval-augmented generation (RAG). ✅ Natural Language Processing (NLP) – Skilled in preprocessing, entity recognition, sentiment analysis, and embeddings. ✅ MLOps & DevOps – Experienced with CI/CD pipelines, Docker, GitHub Actions, and deployment on scalable cloud infrastructure. ✅ Cloud Platforms – Hands-on with AWS (S3, Lambda, SageMaker, EC2) and GCP, building and managing scalable ML pipelines. ✅ API Integration – Deploy models via RESTful APIs using FastAPI/Flask for production-ready ML apps. ✅ Data Engineering – Strong skills in data cleaning, transformation, and feature engineering for robust model development. ✅ End-to-End Deployment – From data preprocessing to real-time model deployment and monitoring.Big Data
DevOpsCloud ComputingAIOpsMLOpsRPythonData ScienceArtificial IntelligenceMachine Learning - $26 hourly
- 0.0/5
- (0 jobs)
I'm an experienced Data Engineer and IT professional with over 10 years of expertise in software development, data analysis, and cloud technologies. My technical skills include Talend, Databricks, Hadoop, Hive, Spark, SQL, Power BI, Data Warehousing, Database Design, Query Optimization, and Performance Tuning. I pride myself on attention to detail, clear communication, and efficiently delivering accurate results. Whether you need assistance with data integration, analysis, visualization, or performance optimization, I'm dedicated to providing effective solutions. I'm friendly, responsive, and always happy to clarify questions or discuss ideas along the way. My goal is to ensure you're completely satisfied by exceeding your expectations. Let's work together to achieve your project goals successfully!Big Data
Databricks PlatformLinuxHiveTalend Data IntegrationApache HadoopPythonJavaPHPCodeIgniterApache SparkSQL - $20 hourly
- 0.0/5
- (2 jobs)
Hello there! Before talking about qualifications and professional abilities, I would like to introduce myself. I am Rusiru Kanchane and I am from Sri Lanka. Taking web development/Standalone software development as a profession not only fulfills my pocket but also my heart because it has been my passion since my early teenage. I believe that people should do things in which they are good at or in which their heart lays. That’s why I chose freelance web development as my career because I believe I’m good at this and I am always honest and I am never afraid of doing hard work. I have finished my graduation from The Java Institute for Advanced Technology on Software Engineering and I have taken many lessons on modern web designing from famous institutions. My education background allows me to thrive in this career and my trainings on this have made me a master of this section. I am very much expert in using both native java and java frameworks. I have developed various websites,standalone software and also I have done SEO. I am sure that if you hire me, I will present you many successful projects with minimal efforts from your side. Technologies : Front-End Web fundamentals like HTML, JavaScript, and CSS CSS preprocessors like Sass or LESS JavaScript frameworks like AngularJS, React, or Ember etc., or JS-based build tools like Grunt, Gulp, and Bower Libraries like jQuery or Backbone.js Front-end (CSS) frameworks like Foundation or Bootstrap AJAX Back-End API design and development CRUD (Create, Read, Update, Delete) RESTful Services Web fundamentals like HTML, JavaScript, and CSS Server-side languages like Java, JavaScript, and .Net Database technologies like MySQL, Oracle, PostgreSQL, MariaDB and MongoDB. Web server technologies like Node.js, J2EE, Apache, Nginx, Glassfish, Wildfly, ISS, etc. Thank you.Big Data
DockerAWS LambdaREST APIJavaDatabase ProgrammingJava Persistence APIApache SupersetHTMLJavaScriptHibernateHTML5CSS 3DatabaseMySQL - $25 hourly
- 5.0/5
- (6 jobs)
Freelancer with various skills and experience in Data Science field. I will be glad to contribute to your projects in a mutually beneficial way. My skills include machine learning, deep learning, web scraping, data engineering, web development, and data visualizations. My main programming languages are Python, R, and SQL. I can create interactive web applications and dashboards using Python's Dash framework and R's shiny package so you will be able to observe, analyze and present various aspects of your business and other activities in effective ways. Importantly, I have skills in math and statistics essential to understand the processes behind code and interpret outcomes from it. I am doing my MSC with a focus on data science. I will focus on understanding your business goals and implementing solutions to make them come true. My skills include: ✔️ Kafka ✔️ Data Science ✔️ Machine Learning ✔️ Deep Learning ✔️ Interactive Visualizations/Dashboards ✔️ Data Engineering (MySQL, MongoDB) ✔️ Python, R, SQL ✔️ Recommender Systems ✔️ DevOps (ML Deep Learning model deployment on cloud, TDD, AWS, GCP, Docker) ✔️ OCR ✔️ Computer Vision ✔️ Natural Language Processing NLP (Bert, fastText) ✔️ CNN (LeNet, AlexNet, VGG1619, InceptionV3, ResNet50) ✔️ OpenCV ✔️ Web Scraping ✔️ Web Crawling ✔️ API Clients ✔️ Keras, Tensorflow ✔️ PyTorch ✔️ Dash, Shiny, Plotly, Streamlit ✔️ Pandas, Numpy, Scipy, Scrapy, Selenium, requests, ggplot2 ✔️AirflowBig Data
Google Cloud PlatformMachine LearningTableauApache HadoopApache SparkBigQueryAmazon Web ServicesDatabase ArchitectureArtificial IntelligenceApache AirflowJavaData ScienceApache KafkaSQLETL Pipeline - $10 hourly
- 0.0/5
- (0 jobs)
Hi, have 4 year experience in Ebay Dropshiping. I am main tain deferant lot of account so I have goos knowledge and experience in this side.Big Data
AccountingData AnalysisOffice 365Microsoft Excel PowerPivotMicrosoft ExcelExcel Formula - $10 hourly
- 0.0/5
- (0 jobs)
As a highly experienced professional and Microsoft Certified data engineer, I possess a unique set of skills and expertise in data scraping and visualization from various sources. I am well-versed in Python scripting and am certified as an Azure Associate Data Engineer. Additionally, I have a strong understanding of both Azure and AWS. I have a track record of successfully completing projects and achieving outstanding results. Some of my key accomplishments include: Successfully scraped and analyzed large sets of data to provide valuable insights for a major retail company, resulting in a significant increase in sales. Developed a custom data visualization dashboard for a healthcare organization, allowing them to easily track key performance indicators and make data-driven decisions. Implemented a data pipeline on Azure for a financial services company, increasing the speed and efficiency of their data processing. I hold a Bachelor's degree in Computer Science and have continued to stay current with industry developments through ongoing professional development and training. I am detail-oriented, highly motivated, and dedicated to delivering high-quality work. I am confident that my skills and experience make me an excellent candidate for any data engineering project.Big Data
Data IntegrationSQLCloud ComputingAWS Cloud9Data VisualizationData Warehousing & ETL SoftwareMicrosoft AzureScriptingPythonSelenium - $19 hourly
- 0.0/5
- (0 jobs)
SUMMARY Data Analyst | Business Intelligence | SQL, Python, Power BI Passionate about turning data into actionable insights. Experienced in customer behaviour analysis and performance tracking. Skilled in building interactive dashboards and data-driven solutions to optimise business processes.Big Data
Business IntelligenceBusiness ConsultingCritical Thinking SkillsPythonSQLTableauMicrosoft Power BIMachine LearningBusiness AnalysisCustomer AnalysisData MiningData Analysis Want to browse more freelancers?
Sign up
How hiring on Upwork works
1. Post a job
Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.
2. Talent comes to you
Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.
3. Collaborate easily
Use Upwork to chat or video call, share files, and track project progress right from the app.
4. Payment simplified
Receive invoices and make payments through Upwork. Only pay for work you authorize.