Friendli: the fastest serving engine for generative AI
APACHE-2.0 License
Instruction/chat prompts creation library for text generation LLMs. It supports local and Hugging...
🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline ca...
Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Groq, Gemini, Cohere, ...)
telegram bot for self-hosted local inference of stable diffusion, text-to-speech and large langua...
Run LLMs locally with as little friction as possible.
Query LLM with Chain-of-Tought
Simple LLM library for JavaScript
An OpenAI-like LLaMA inference API
Emulates Azure OpenAI API on your local machine using Ollama and open-source models.
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable fo...
GPT-4 level function calling models for real-world tool using use cases
LLMs Run Riot in Production. Get Back in The Driving Seat. Build Your Own Evals, Iterate Quickly,...
Dify in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Fe...
The TypeScript library for building AI applications.
The unofficial DSPy framework. Build LLM powered Agents and "Agentic workflows" based on the Stan...