AutoGPTQ

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

MIT License

Downloads
742
Stars
4.3K
Committers
32