Robust-Prefix-Tuning

P-tuning-v2

An optimized deep prompt tuning strategy comparable to fine-tuning across scales and tasks

GLM-130B

GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

GLM

GLM (General Language Model)

sentiment-discovery

Unsupervised Language Modeling at scale for robust sentiment classification

long_llama

LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA a...

ChatLM-mini-Chinese

中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sf...

progen

Implementation and replication of ProGen, Language Modeling for Protein Generation, in Jax

meditron

Meditron is a suite of open-source medical Large Language Models (LLMs).

open-instruct

OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities...

Megatron-LM

Ongoing research training transformer models at scale

minichatgpt

minichatgpt - To Train ChatGPT In 5 Minutes

TAADpapers

Must-read Papers on Textual Adversarial Attack and Defense

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vi...

TextAttack

TextAttack 🐙 is a Python framework for adversarial attacks, data augmentation, and model trainin...