pyspark-realtime-streaming-sentiment-analysis

⏱ Real-Time Sentiment Analysis using PySpark and simulation of Twitter/X API using FastAPI

Spark-Structured-Streaming-Examples

Spark Structured Streaming / Kafka / Cassandra / Elastic

Reddit-Analysis

Sentiment Analysis on streaming data and batch data from Reddit

Lambda-Arch-Spark

DataStreamingETL

Utilizing my background and love for Apache Airflow and Data to build a real-time data streaming ...

streaming-orders

Project to stream real-time orders and apply some ETL pipelines & analytics using DataBricks, Kaf...

Log-Analysis-Project

This project builds a scalable log analytics pipeline use Lambda architecture for real-time and b...

End-to-end-realtime-data-streaming

An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage...

Credit-Card-Fraud-Detection-Spark

Data_Processing_using_Spark_Flink

This project demonstrates data cleaning, processing with Apache Spark and Apache Flink, both loca...

SparkPythonBigData

Big-Data with Apache Spark and Python.

hdfs-stream-processing

Streaming data processing using Hadoop HDFS, Spark, Kafka, Minio, Elasticsearch

Sales-Analytics-Pipeline

Data analytics pipeline built with Apache Spark and Hadoop for processing and analyzing large-sca...

pyspark-maestro

This repo contains implementations of PySpark for real-world use cases for batch data processing,...

football-big-data

This is a comprehensive solution for real-time football analytics, leveraging Apache Spark execut...