An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
MIT License
🦖 X—LLM: Cutting Edge & Easy LLM Finetuning
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware o...
torchao: PyTorch Architecture Optimization (AO). Performant kernels that work with PyTorch.
🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.
A Native-PyTorch Library for LLM Fine-tuning
State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reprod...
Large Language Model Text Generation Inference
Run PyTorch LLMs locally on servers, desktop and mobile