Utilizing my background and love for Apache Airflow and Data to build a real-time data streaming ...
Big-Data with Apache Spark and Python.
⏱ Real-Time Sentiment Analysis using PySpark and simulation of Twitter/X API using FastAPI
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage...
End-to-end data pipeline that ingests, processes, and stores data. It uses Apache Airflow to sche...
Sentiment Analysis on streaming data and batch data from Reddit
In this project, we developed an ETL pipeline using Apache Airflow to process delivery data and t...
Spark Structured Streaming / Kafka / Cassandra / Elastic
Welcome to StreamlineDE, an end-to-end data engineering project designed to demonstrate real-time...
Java Application, uses Apache Spark, handles batch as well as streaming processing
Spark structured streaming with Kafka data source and writing to Cassandra
Streaming data processing using Hadoop HDFS, Spark, Kafka, Minio, Elasticsearch