Spark-Kafka-Self-Learning
πππ A third-year student is self-studying Spark and Kafka as part of their π· data engineering journey, with the goal of securing an π¬ internship or fresher job in 2024.
APACHE-2.0 License
Stars
2
Committers
1
π Apache kafka Self-Learning π
A third-year student is self-studying Spark and Kafka as part of their data engineering journey, with the goal of securing an internship or fresher job in 2024.
π¦ Technologies
DockerPostgreSQLApache SparkApache KafkaZookeeper
π¦ Architecture
1. Apache Spark
SparkContextDriver ProgramCluster ManagerWorker NodeExecutorCacheTask
2. Apache Kafka
ProducerConsumerBrokerClusterTopicPartitionOffsetConsumer-group