You will get Big Data processing with Apache Flink or Spark in python
Project details
Welcome ;
I am Big Data Engineer with 5 years of experience,
I can help you in building your big data project, including data ingestion (using Apache Kafka), data storage ( in Hadoop or Amazon S3 or your remote Data Lake), data processing in batch or stream (real time) with pySpark or pyFlink, data analysis (using machine learning algorithm and MLlib for big data) , and also anlaysis and visualisation in dashboard
Well, My Services Include:
Design of your Big data architecture of Batch and Stream pipelines
Benchamrking of the right Big Data tools that suit your project
Creation of Data lake for Storage (Hadoop, HBase, Amazon S3 ...)
Data ingestion of data using Apache Kafka
ETL Jobs + Transformations on Data in PySpark / PyFlink / SQL
Batch & Stream processing (in real time) : PyFlink /PySpark)
NoSQL : MongoDB , Elasticsarch, Cassandra
Data Analysis using Pandas Dataframes
Data Visualisation in static or dynamic dashboard (kibana /tableau ..)
Also I have experience with:
MapReduce
HDFS
Spark
Scala
Oozie
SQL
Hive
Tableau
Excel
Pig
Spark streaming
I am Big Data Engineer with 5 years of experience,
I can help you in building your big data project, including data ingestion (using Apache Kafka), data storage ( in Hadoop or Amazon S3 or your remote Data Lake), data processing in batch or stream (real time) with pySpark or pyFlink, data analysis (using machine learning algorithm and MLlib for big data) , and also anlaysis and visualisation in dashboard
Well, My Services Include:
Design of your Big data architecture of Batch and Stream pipelines
Benchamrking of the right Big Data tools that suit your project
Creation of Data lake for Storage (Hadoop, HBase, Amazon S3 ...)
Data ingestion of data using Apache Kafka
ETL Jobs + Transformations on Data in PySpark / PyFlink / SQL
Batch & Stream processing (in real time) : PyFlink /PySpark)
NoSQL : MongoDB , Elasticsarch, Cassandra
Data Analysis using Pandas Dataframes
Data Visualisation in static or dynamic dashboard (kibana /tableau ..)
Also I have experience with:
MapReduce
HDFS
Spark
Scala
Oozie
SQL
Hive
Tableau
Excel
Pig
Spark streaming
Data Tool
PythonWhat's included
| Service Tiers |
Starter
$10
|
Standard
$30
|
Advanced
$100
|
|---|---|---|---|
| Delivery Time | 1 day | 5 days | 7 days |
Number of Revisions | 2 | 3 | 5 |
Source Code | - | - |
About Zakaria
Big Data Engineer, Data Scientist & AI Specialist
Rabat, Morocco - 4:10 am local time
💡 AI & Machine Learning:
I have a deep understanding of machine learning algorithms, predictive modeling, and AI-driven analytics. My proficiency in Python, TensorFlow, and other AI frameworks allows me to design and implement AI models that optimize decision-making and drive business growth. I also excel in Natural Language Processing (NLP), including sentiment analysis, text classification, and language modeling using advanced frameworks like Hugging Face Transformers.
💻 Big Data Solutions:
I am experienced in building end-to-end Big Data solutions, including data modeling, batch & stream processing, designing data warehouses/lakes, setting up ETL pipelines, and data ingestion using Kafka. I also create insightful dashboards and charts to help businesses make data-driven decisions.
🔧 Technical Skills:
🐍 Python scripting
🌐 Web scraping
🛢️ Big Data storage & Data lakes: Hadoop, HBase, S3
🔍 Elasticsearch/Kibana/Logstash (ELK)
🖥️ Hadoop setup: Standalone, Cloudera, HortonWorks
🛠️ SQL Databases: MySQL, PostgreSQL
📊 NoSQL Databases: HBase, MongoDB
⚡ Apache Spark (with MLlib, GraphX)
🚀 Batch & stream (real-time) processing
🌀 Apache Flink, PyFlink
📥 Data ingestion: Apache Kafka, Kafka Connect
🗓️ Scheduling: Apache Airflow
🔧 Installation & configuration: Big Data tools in multi-node clusters
🤖 Machine Learning & Sentiment Analysis
🧠 Deep Learning
📊 Data visualization: MS BI, Tableau, Power BI, Kibana
Steps for completing your project
After purchasing the project, send requirements so Zakaria can start the project.
Delivery time starts when Zakaria receives requirements from you.
Zakaria works on your project following the steps below.
Revisions may occur after the delivery date.
Batch & stream big data processing and analytics