Low rank adaptation (LoRA) for Candle.
MIT License
This repository lists some awesome public Rust projects, Videos, Blogs and Jobs.
Unofficial python bindings for the rust llm library. 🐍❤️🦀
Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.
Blazingly fast LLM inference.
An ecosystem of Rust libraries for working with large language models
Distributed LLM and StableDiffusion inference for mobile, desktop and server.
Minimalist ML framework for Rust