Quick-Commerce-BigBasket-DataLakeHouse
A datalake house project build with Spark, Airflow, Docker, Minio and much more !
Possibly Available
About
Data Engineer: Python | SQL | Spark | Kafka | AWS | Docker | Airflow | Data Modeling, Data Pipelines, Data Warehousing, Data Lakes, Analytics
Evidence-backed skills
Repositories
gcp-music-event-streaming
Data Pipeline built using Airflow, dbt, Kakfa, Spark, GCP, Docker, Terraform
streaming-kafka-pyspark-avro
Streaming Data Pipeline for NYC taxi Rides build using kafka and Pyspark locally running on docker containers
de-zoomcamp
My Learning from DataTalksClub data-engineering-zoomcamp
aws-spark-unstructured-data-pipeline
Data Pipeline for unstructured data on AWS with spark