pytorch-memory-optim

This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog post.

APACHE-2.0 License

Stars
81
View Code on GitHub Visit Website View on X
Ecosystems: PyTorch

Statistics for this project are still being loaded, please check back later.

Related Projects
vision

Datasets, Transforms and Models specific to Computer Vision

09 Nov 2016 15,542
s3ima

Exploration of Self-Semi-Supervised learning for handling unlabeled data

18 Nov 2023 3
torchoutil

Collection of functions and modules to help development in PyTorch.

24 Jan 2024 1
TensorRT

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

11 Mar 2020 2,359
pytorch-tutorial

PyTorch Tutorial for Deep Learning Researchers

10 Mar 2017 29,908
PyTorch-SimCLR

Experiments of Pytorch SimCLR: A Simple Framework for Contrastive Learning of Visual Representations

15 Apr 2024 4
matorage

Matorage is tensor(multidimensional matrix) object storage manager for deep learning framework(Py...

04 Jun 2020 73
pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

13 Aug 2016 77,536
torchsnapshot

A performant, memory-efficient checkpointing library for PyTorch applications, designed with larg...

25 May 2022 132
torchrec

Pytorch domain library for recommendation systems

12 Jul 2021 1,889
V1T

Code for "V1T: Large-scale mouse V1 response prediction using a Vision Transformer"

20 Jun 2022 18
how-to-read-pytorch

Quick, visual, principled introduction to pytorch code through five colab notebooks.

12 Jun 2020 306
SSD

High quality, fast, modular reference implementation of SSD in PyTorch

06 Dec 2018 1,515
nn-toolbox

A toolbox of commonly used deep learning components, procedures and applications

29 May 2019 17
pytorch-tutorials-examples-and-books

PyTorch tutorials, examples and some books I found 【不定期更新】整理的PyTorch 最新版教程、例子和书籍

10 Nov 2018 1,089