Ecosystems:
Llama
Bot releases are visible (Hide)
llama.cpp
- v1.2.3
Published by jan-grzybek-ampere 4 months ago
- The rebase is to allow llama-cpp-python to pick up upstream CVE fix (https://github.com/abetlen/llama-cpp-python/security/advisories/GHSA-56xg-wfcc-g829)
- Experimental support for Q8R16 quantized format with optimized matrix multiplication kernels
- CMake files updated to build llama.aio on AmpereOne
llama.cpp
- v1.2.2
Published by jan-grzybek-ampere 5 months ago
Release notes:
- Fix llama-3 end of token issue
- Update server to support ollama (v0.1.33)
- llama.aio docker support server mode by default
SHA-256 hashes:
- 4e678cb1e42a5d147533732d1b5ba8a77ee7c4d8d54de4c976e7fbd981a69a2b llama_cpp_python-0.2.63.tar.gz
- 6c580006a8faf7b73a424b0020f1bda2684aa7e1796182f68bfa8b7fee08d991 llama_cpp_python-0.2.63-cp311-cp311-linux_aarch64.whl
- 1ffde8093abe18f638fb89273dd56664dd7ff6b8c82383099ea620d18ab562a7 llama_aio_v1.2.2_b769bc1.tar.gz