Orchestrated sonar data processing workflow
MIT License
This repository features an ETL pipeline for retrieving, processing, validating, and ingesting ga...
Real-time financial data processing using Apache Kafka, Spark, MySQL, and Grafana, orchestrated w...
A data engineering training project to build an end-to-end pipline for a real-time processing of ...
Data Lakehouse local stack with PySpark, Trino, and Minio. Includes an example to process Raygun ...
Python Prefect tutorial
A Python framework for data processing on GCP.
log data pre processing in python
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to da...
GenAIOps with Prompt Flow is a "GenAIOps template and guidance" to help you build LLM-infused app...
A personal project that builds an end-to-end data pipeline using the 2024 Olympics data.