MeZO

OwLore

Official Pytorch Implementation of "OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection...

TinyGPT-V

TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vi...

self-rewarding-lm-pytorch

Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI

MiniCPM

MiniCPM3-4B: An edge-side LLM that surpasses GPT-3.5-Turbo.

OpenMoE

A family of open-sourced Mixture-of-Experts (MoE) Large Language Models

meditron

Meditron is a suite of open-source medical Large Language Models (LLMs).

open-instruct

GLM

GLM (General Language Model)

long_llama

LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA a...

Megatron-LM

Ongoing research training transformer models at scale

AQLM

Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantiz...

minichatgpt

minichatgpt - To Train ChatGPT In 5 Minutes

Robust-Prefix-Tuning

code for the ICLR'22 paper: On Robust Prefix-Tuning for Text Classification

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.