Training and serving large-scale neural networks with auto parallelization.
APACHE-2.0 License
Code and documentation to train Stanford's Alpaca models, and generate the data.
An open platform for training, serving, and evaluating large language models. Release repo for Vi...
minichatgpt - To Train ChatGPT In 5 Minutes
An Easy-to-use, Scalable and High-performance RLHF Framework (70B+ PPO Full Tuning & Iterative DP...
OpenChat: Advancing Open-source Language Models with Imperfect Data
Learn about the Neumorphic engineering process of creating large-scale integration (VLSI) systems...
20+ high-performance LLM implementations with recipes to pretrain, finetune and deploy at scale.
Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)
GPT implementation in Flax
Machine learning Guide. Learn all about Machine Learning Tools, Libraries, Frameworks, Large Lang...
LongLLaMA is a large language model capable of handling long contexts. It is based on OpenLLaMA a...
Dromedary: towards helpful, ethical and reliable LLMs.
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating poin...
JAX-based neural network library