JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
APACHE-2.0 License
pyspark🍒🥭 is delicious,just eat it!😋😋
Spark examples
Apache Spark - A unified analytics engine for large-scale data processing
Asynchronous actions for PySpark
A Python package to submit and manage Apache Spark applications on Kubernetes.
A simple VS Code devcontainer setup for local PySpark development
Sparglim✨ makes PySpark App Configurable and Deploy Spark Connect Server Easier!
Spark extension for processing large-scale 3D data sets: Astrophysics, High Energy Physics, Meteo...
Performance Observability for Apache Spark
A free tutorial for Apache Spark.
REST job server for Apache Spark
Apache Spark Kubernetes Operator
A tool for monitoring and tuning Spark jobs for efficiency.
ETL pipeline using pyspark (Spark - Python)
Jupyter magics and kernels for working with remote Spark clusters