GaLore

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

APACHE-2.0 License

Downloads
21.4K
Stars
1.2K
View Code on GitHub
Ecosystems: Python

Issue Statistics

Past Year

All Time

Total Pull Requests
19
19
Merged Pull Requests
10
10
Total Issues
96
96
Time to Close Issues
5 days
5 days
Package Rankings
Top 36.88% on Pypi.org
Related Projects
LongLoRA

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

21 Sep 2023 2,607
iLLaMA

Adapting LLaMA Decoder to Vision Transformer

19 May 2024 6
FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vi...

19 Mar 2023 36,628
SpQR

05 Jun 2023 508
AQLM

Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantiz...

12 Jan 2024 797
open-instruct

09 Jun 2023 1,214
TinyGPT-V

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

28 Dec 2023 1,237
long_llama

LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA a...

06 Jul 2023 1,448
Complex-YOLOv4-Pytorch

The PyTorch Implementation based on YOLOv4 of the paper: "Complex-YOLO: Real-time 3D Object Detec...

03 Jul 2020 1,234
VAR

[GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregress...

01 Apr 2024 2,568
OwLore

Official Pytorch Implementation of "OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection...

27 May 2024 5
LGM

[ECCV 2024 Oral] LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creation.

06 Feb 2024 1,590
GLM

GLM (General Language Model)

18 Mar 2021 3,170
minichatgpt

minichatgpt - To Train ChatGPT In 5 Minutes

23 Feb 2023 155
GLM-130B

GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

03 Aug 2022 7,654