UReader

mm-cot

Official implementation for "Multimodal Chain-of-Thought Reasoning in Language Models" (stay tune...

OFA

Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities...

ceval

Official github repo for C-Eval, a Chinese evaluation suite for foundation models [NeurIPS 2023]

Monkey

【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large...

VisCPM

[ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模...

chain-of-hindsight

Chain-of-Hindsight, A Scalable RLHF Method

FastChat

An open platform for training, serving, and evaluating large language models. Release repo for Vi...

MT-SFT-ShareGPT

MiniCPM

MiniCPM3-4B: An edge-side LLM that surpasses GPT-3.5-Turbo.

InternLM

Official release of InternLM2 7B and 20B base and chat models. 200K context support

F-LMM

Code Release of F-LMM: Grounding Frozen Large Multimodal Models

clip-jax

Train vision models using JAX and 🤗 transformers

Video-LLaVA

【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

Twin-Merging

Twin-Merging: Dynamic Integration of Modular Expertise in Model Merging

long_llama

LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA a...