kafka-spark-example

An example data pipeline to count Twitter hashtags, built with Docker-Compose, Kafka, PySpark and Cassandra.

MIT License

Stars

Ecosystems: Python

Statistics for this project are still being loaded, please check back later.

A structured streaming was applied to the robot data from ROS-Gazebo simulation environment using...

End-to-end data pipeline that ingests, processes, and stores data. It uses Apache Airflow to sche...

Welcome to StreamlineDE, an end-to-end data engineering project designed to demonstrate real-time...

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Stre...