optimum

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

APACHE-2.0 License

Downloads
946K
Stars
2.1K
Committers
84
View Code on GitHub Visit Website
Ecosystems: PyTorch

Commit Statistics

Past Year

All Time

Total Commits
575
864
Total Committers
69
89
Avg. Commits Per Committer
8.33
9.71
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
229
451
Merged Pull Requests
168
325
Total Issues
177
373
Time to Close Issues
23 days
about 1 month
Package Rankings
Top 1.36% on Pypi.org
Top 21.48% on Conda-forge.org
Top 38.25% on Anaconda.org
Badges
Extracted from project README
ONNX Runtime
Related Projects
Transformers-Tutorials

This repository contains demos I made with the Transformers library by HuggingFace.

31 Aug 2020 9,151
ao

torchao: PyTorch Architecture Optimization (AO). Performant kernels that work with PyTorch.

03 Nov 2023 193
ort

Accelerate PyTorch models with ONNX Runtime

08 Feb 2021 353
video-transformers

Easiest way of fine-tuning HuggingFace video classification models

12 Aug 2022 131
Keras-OneClassAnomalyDetection

[5 FPS - 150 FPS] Learning Deep Features for One-Class Classification (AnomalyDetection). Corresp...

06 Jan 2019 127
text-generation-inference

Large Language Model Text Generation Inference

08 Oct 2022 7,916
nlpboost

Python library for automatic training, optimization and comparison of Transformer models on most ...

28 Dec 2022 20
AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

13 Apr 2023 4,292
Pointcept

Pointcept: a codebase for point cloud perception research. Latest works: PTv3 (CVPR'24 Oral), PPT...

21 Mar 2023 1,143