unify

LLMs Run Riot in Production. Get Back in The Driving Seat. Build Your Own Evals, Iterate Quickly, and Go from Prototype to Production in No Time ⚡

APACHE-2.0 License

Downloads
6.1K
Stars
177
Committers
10
View Code on GitHub Visit Website View on X
Ecosystems: Llama, Python

Commit Statistics

Past Year

All Time

Total Commits
515
515
Total Committers
12
12
Avg. Commits Per Committer
42.92
42.92
Bot Commits
0
0

Issue Statistics

Past Year

All Time

Total Pull Requests
32
32
Merged Pull Requests
24
24
Total Issues
13
13
Time to Close Issues
3 months
3 months
Package Rankings
Top 36.52% on Pypi.org
Related Projects
cria

Run LLMs locally with as little friction as possible.

20 Apr 2024 114
LlmTornado

One .NET library to consume OpenAI, Anthropic, Cohere, Google, Azure, Groq, and self-hosed APIs.

08 Oct 2023 32
llm.js

Simple LLM library for JavaScript

21 Apr 2023 8
empower-functions

GPT-4 level function calling models for real-world tool using use cases

10 May 2024 204
query-llm

Query LLM with Chain-of-Tought

22 Jun 2024 3
lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable fo...

22 Jul 2023 1,967
easy-llms

Easy "1-line" calling of all LLMs from OpenAI, MS Azure, AWS Bedrock, GCP Vertex, and Ollama

05 Jun 2024 43
libre-chat

🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline ca...

26 Jul 2023 128
chat.petals.dev

💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

28 Dec 2022 306
llmcord.py

A Discord LLM chat bot that supports any OpenAI compatible API. Run a local model with ollama, oo...

08 May 2023 278
llama-server

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.

03 Apr 2023 111
botality-ii

telegram bot for self-hosted local inference of stable diffusion, text-to-speech and large langua...

11 Mar 2023 37
promptflow_unify_integration

The tool package for Microsoft's Prompt flow and the VS Code extension

08 Aug 2024 1
rust-genai

Rust multiprovider generative AI client (Ollama, OpenAi, Anthropic, Groq, Gemini, Cohere, ...)

01 Jun 2024 182
friendli-client

Friendli: the fastest serving engine for generative AI

20 Jul 2023 40