pytorch-memonger

Sublinear memory optimization for deep learning. https://arxiv.org/abs/1604.06174

MIT License

Stars
587
View Code on GitHub
Ecosystems: Python

Issue Statistics

Past Year

All Time

Total Pull Requests
0
1
Merged Pull Requests
0
0
Total Issues
1
9
Time to Close Issues
N/A
2 months
Related Projects
gradient-checkpointing

Make huge neural nets fit in memory

26 Sep 2017 2,702
quantized-training

Explore training for quantized models

16 Jul 2024 9
DropNeuron

DropNeuron: Simplifying the Structure of Deep Neural Networks

13 Jun 2016 57
bottleneck-transformer-pytorch

Implementation of Bottleneck Transformer in Pytorch

28 Jan 2021 670
yet-another-retnet

A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Tran...

01 Aug 2023 101
the-incredible-pytorch

The Incredible PyTorch: a curated list of tutorials, papers, projects, communities and more relat...

11 Feb 2017 11,389
pytorch_misc

Code snippets created for the PyTorch discussion board

15 Nov 2018 539
mxnet-mobilenet-v2

Reproduction of MobileNetV2 using MXNet

29 Mar 2018 129
torchstat

Model analyzer in PyTorch

26 Oct 2018 1,460
dilated-attention-pytorch

(Unofficial) Implementation of dilated attention from "LongNet: Scaling Transformers to 1,000,000...

09 Jul 2023 50
torchinfo

View model summaries in PyTorch!

16 Mar 2020 2,523
hybrid-discriminative-generative

Hybrid Discriminative-Generative Training via Contrastive Learning

17 Jul 2020 75
Efficient-PyTorch

My best practice of training large dataset using PyTorch.

29 Mar 2018 1,081
nanotron

Minimalistic large language model 3D-parallelism training

11 Sep 2023 1,080
memformer

Implementation of Memformer, a Memory-augmented Transformer, in Pytorch

10 Oct 2020 106