tuberia

pyspark-style-guide

This is a guide to PySpark code style presenting common situations and the associated best practi...

goodreads_etl_pipeline

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

data-engineering-test-tasks

bcpandas

High-level wrapper around BCP for high performance data transfers between pandas and SQL Server. ...

pipda

A framework for data piping in python

APACHE-SPARK-PYSPARK-DATABRICKS-MACHINE-LEARNING-MLIB

Apache Spark Machine Learning project using MLlib and Linear Regression on Databricks!

spark

Apache Spark - A unified analytics engine for large-scale data processing

Complete-Data-Science-Roadmap

Complete Roadmap For Data Science

tods

TODS: An Automated Time-series Outlier Detection System

Spark-with-Python

Fundamentals of Spark with Python (using PySpark), code examples

pipesnake

a pandas sklearn-inspired pipeline data processor

home-credit-default-risk

Default risk prediction for Home Credit competition - Fast, scalable and maintainable SQL-based f...

datafaucet

Productivity Utilities for Data Science with Python Notebooks

Spark-with-Python---My-learning-notes-

ETL pipeline using pyspark (Spark - Python)

wald-stack-demo

🌳 WALD Stack Demo 🏎️