Qwen-TensorRT-LLM

MIT License

Stars
552
View Code on GitHub
Ecosystems: Python

Issue Statistics

Past Year

All Time

Total Pull Requests
9
9
Merged Pull Requests
9
9
Total Issues
139
139
Time to Close Issues
16 days
16 days
Package Rankings
Top 6.74% on Proxy.golang.org
Badges
Extracted from project README
Stargazers over time
Related Projects
intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques fo...

11 Nov 2022 1,909
pandallm

Panda项目是于2023年5月启动的开源海外中文大语言模型项目，致力于大模型时代探索整个技术栈，旨在推动中文自然语言处理领域的创新和合作。

28 Apr 2023 1,064
GPTQ-for-LLaMa

4 bits quantization of LLaMA using GPTQ

06 Mar 2023 2,986
transformer-deploy

Efficient, scalable and enterprise-grade CPU/GPU inference server for 🤗 Hugging Face transformer ...

31 Oct 2021 1,644
sit4onnx

Tools for simple inference testing using TensorRT, CUDA and OpenVINO CPU/GPU and CPU providers. S...

12 May 2022 18
minimind

【大模型】3小时完全从0训练一个仅有26M的小参数GPT，最低仅需2G显卡即可推理训练！

27 Jul 2024 2,087