🚀 Invoke multiple large language models concurrently and the rank results. Add new models and ranking functions quickly.. ⭐
MIT License
Powering Agent Chains by Constraining LLM Outputs
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable fo...
Unofficial python bindings for the rust llm library. 🐍❤️🦀
An OpenAI-like LLaMA inference API
A lightweight library that leverages Language Models (LLMs) to enable natural language interactio...
Simple LLM library for JavaScript
🦙 Integrating LLMs into structured NLP pipelines
Inference code for CodeLlama models
telegram bot for self-hosted local inference of stable diffusion, text-to-speech and large langua...
`llm-chain` is a powerful rust crate for building chains in large language models allowing you to...
Rack API application for Llama.cpp
Python bindings for llama.cpp
Desktop AI Assistant powered by GPT-4, GPT-4 Vision, GPT-3.5, Gemini, Claude, Llama 3, DALL-E, La...
Python library for the instruction and reliable validation of structured outputs (JSON) of Large ...
GPT-4 level function calling models for real-world tool using use cases