Code-LMs

GLM

GLM (General Language Model)

Megatron-LM

Ongoing research training transformer models at scale

sentiment-discovery

Unsupervised Language Modeling at scale for robust sentiment classification

BambooAI

A lightweight library that leverages Language Models (LLMs) to enable natural language interactio...

TransCoder

Public release of the TransCoder research project https://arxiv.org/pdf/2006.03511.pdf

ChatLM-mini-Chinese

中文对话0.2B小模型（ChatLM-Chinese-0.2B），开源所有数据集来源、数据清洗、tokenizer训练、模型预训练、SFT指令微调、RLHF优化等流程的全部代码。支持下游任务sf...

starcoder2

Home of StarCoder2!

Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

CodeGeeX

CodeGeeX: An Open Multilingual Code Generation Model (KDD 2023)

lm-evaluation-harness

A framework for few-shot evaluation of language models.

CodeGeeX2

CodeGeeX2: A More Powerful Multilingual Code Generation Model

vec2text

utilities for decoding deep representations (like sentence embeddings) back to text

long_llama

LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA a...

code2vec

TensorFlow code for the neural network presented in the paper: "code2vec: Learning Distributed Re...

open-instruct