metaphysical materialist.
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Python - Released: 15 Jun 2023 - 4,364
OpenMMLab Model Deployment Framework
Python - Released: 24 Dec 2021 - 2,729
An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
Python - Released: 11 Jul 2023 - 3,820
row-major matmul optimization
C++ - Released: 28 Oct 2018 - 571
LLaMa/RWKV onnx models, quantization and testcase
Python - Released: 04 Apr 2023 - 346
ncnn Rust API.
Rust - Released: 08 Dec 2021 - 38
symmetric int8 gemm
Assembly - Released: 15 Jul 2019 - 66
cpp syntactic sugar
Python - Released: 09 Oct 2020 - 8
Tengine 管子是用来快速生产 demo 的辅助工具
C++ - Released: 11 Jul 2021 - 13
硬件模型库芯片评测
Python - Released: 09 Jun 2023 - 7
