floneum

A toolkit for controllable, private AI on consumer hardware in rust

APACHE-2.0 License

Downloads
70.1K
Stars
938
Committers
9
View Code on GitHub Visit Website
Ecosystems: Llama, Whisper, Rust

Commit Statistics

Past Year

All Time

Total Commits
876
1,172
Total Committers
9
10
Avg. Commits Per Committer
97.33
117.2
Bot Commits
6
6

Issue Statistics

Past Year

All Time

Total Pull Requests
112
185
Merged Pull Requests
107
179
Total Issues
46
102
Time to Close Issues
2 days
29 days
Package Rankings
Related Projects
botality-ii

telegram bot for self-hosted local inference of stable diffusion, text-to-speech and large langua...

11 Mar 2023 37
libre-chat

🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline ca...

26 Jul 2023 128
multi-mediawiki-rag

A simple RAG chatbot that can retrieve from a mediawiki data dump

15 Dec 2023 17
llm-chain

`llm-chain` is a powerful rust crate for building chains in large language models allowing you to...

24 Mar 2023 1,322
modelfusion

The TypeScript library for building AI applications.

25 May 2023 889
obsidian-bmo-chatbot

Generate and brainstorm ideas while creating your notes using Large Language Models (LLMs) from O...

19 Mar 2023 344
hiramu

An AI Toolbox for Simplified Access to AWS Bedrocks, Ollama from Rust

17 Mar 2024 6
rust-genai

Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Groq, Gemini, Cohere, ...)

01 Jun 2024 182
LlmTornado

One .NET library to consume OpenAI, Anthropic, Cohere, Google, Azure, Groq, and self-hosed APIs.

08 Oct 2023 32
awesome-rust-list

This repository lists some awesome public Rust projects, Videos, Blogs and Jobs.

07 Aug 2022 34
drama_llama

Yet another `llama.cpp` Rust wrapper

14 Apr 2024 2
awesome-llm-and-aigc

🚀🚀🚀A collection of some awesome public projects about Large Language Model, Vision Foundation Mod...

15 Feb 2023 516
llm.js

Simple LLM library for JavaScript

21 Apr 2023 8
vnc-lm

vnc-lm is a Discord bot that lets you talk with and configure language models in your server. It ...

31 Aug 2024 25
ScaleLLM

A high-performance inference system for large language models, designed for production environments.

24 Jul 2023 289