You will get ETL Kinesis Data Pipeline
Project details
Near real time AWS DataPipeline (Kinesis Firehose, S3, Lambda and Athena ) deployed w/ Terraform
Project that utilises Kinesis Firehose to ingest data into a S3 data lake, perform some transformations in AWS Lambda Function (to get location based in coordinates) and copy the transformed data in a new layer in s3. This new data can queried by Amazon Athena. Everyhing is deployed as Infrastructure as Code using Terraform.
Project that utilises Kinesis Firehose to ingest data into a S3 data lake, perform some transformations in AWS Lambda Function (to get location based in coordinates) and copy the transformed data in a new layer in s3. This new data can queried by Amazon Athena. Everyhing is deployed as Infrastructure as Code using Terraform.
What's included
| Service Tiers |
Starter
$300
|
Standard
$1,000
|
Advanced
$3,000
|
|---|---|---|---|
| Delivery Time | 5 days | 15 days | 30 days |
Number of Revisions | 1 | 2 | 3 |
About Vinicius
Data Enginner Airflow, Kafka, Spark, Python, Snowflake, Bigquery,Sql
Brasilia, Brazil - 6:08 am local time
platform building, ETL development, and data engineering, I am passionate about delivering scalable
solutions that enhance business operations. I am skilled in Python, Snowflake, DBT, Kafka, Airflow, AWS,
GitHub, Tableau, SQL, MySQL, and Jira. I have a proven track record of defining the architecture, data
modeling, tooling, and strategy for a large-scale data processing system and maintaining the infrastructure
that supports it I am dedicated to clean code, processes, tools, techniques, and methodologies related to
data engineering. I thrive in dynamic and challenging environments and stay up-to-date with the latest
industry trends.
Steps for completing your project
After purchasing the project, send requirements so Vinicius can start the project.
Delivery time starts when Vinicius receives requirements from you.
Vinicius works on your project following the steps below.
Revisions may occur after the delivery date.
Meeting to better understand the requirements