P-tuning-v2

long_llama

LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA a...

AQLM

Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantiz...

meditron

Meditron is a suite of open-source medical Large Language Models (LLMs).

prompt2model

prompt2model - Generate Deployable Models from Natural Language Instructions

self-rewarding-lm-pytorch

Implementation of the training framework proposed in Self-Rewarding Language Model, from MetaAI

Robust-Prefix-Tuning

code for the ICLR'22 paper: On Robust Prefix-Tuning for Text Classification

OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities...

ChatLM-mini-Chinese

中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sf...

GLM

GLM (General Language Model)

MeZO

[NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/...

SimCR

Code for NAACL 2024 main conference paper "An Empirical Study of Consistency Regularization for E...

Megatron-LM

Ongoing research training transformer models at scale

promptsource

Toolkit for creating, sharing and using natural language prompts.

open-instruct

parler-tts

Inference and training library for high-quality TTS models.