This project integrates real-time data processing and analytics using Apache NiFi, Kafka, Spark, Hive, and AWS services for comprehensive COVID-19 data insights.
MIT License
DevOps resources - Linux, Jenkins, AWS, SRE, Prometheus, Docker, Python, Ansible, Git, Kubernetes...
End-to-end data pipeline that ingests, processes, and stores data. It uses Apache Airflow to sche...
Welcome to StreamlineDE, an end-to-end data engineering project designed to demonstrate real-time...
Dockerizing an Apache Spark Standalone Cluster
Utilizing my background and love for Apache Airflow and Data to build a real-time data streaming ...
A data engineering training project to build an end-to-end pipline for a real-time processing of ...
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage...
A Machine Learning API with native redis caching and export + import using S3. Analyze entire dat...
Real-time financial data processing using Apache Kafka, Spark, MySQL, and Grafana, orchestrated w...