Code for the DataPipes article
BSD-3-CLAUSE License
This is the complementary code for the article Taking Datasets, DataLoaders, and PyTorchs New DataPipes for a Spin.
To recreate the environment used in this blogpost, you can use
conda create --name datapipes python=3.8
conda activate datapipes
pip install -r requirements.txt
The code was run using
Python version: 3.8.13
torch: 1.11.0
torchdata: 0.3.0
Run the 0_download-and-prep-data.ipynb
notebook first to download the dataset. The data loading scripts are all independent and self-contained and can be run in any order
python 1_dataset-csv.py
python 2_imagefolder.py
python 3_datapipes-csv.py