kubeai

Private Open AI on Kubernetes

APACHE-2.0 License

Stars

343

Committers

View Code on GitHub Visit Website

Ecosystems: Llama, Whisper, Kubernetes

Bot releases are hidden (Show)

No releases found yet, please check back later.

Package Rankings

Badges

Extracted from project README

Related Projects

k8sgpt

Giving Kubernetes Superpowers to everyone

21 Mar 2023 4,992

ScaleLLM

A high-performance inference system for large language models, designed for production environments.

24 Jul 2023 289

dialoqbase

Create chatbots with ease

04 Jun 2023 1,410

refact

WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding

19 Apr 2023 1,432

inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference giv...

14 Jun 2023 5,025

kirin

APIs aggregator for inference, fine-tuning and build models.

10 Mar 2024 4

llm.js

Simple LLM library for JavaScript

21 Apr 2023 8

ollama-operator

Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫

10 Apr 2024 7

LocalAI

The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in ...

18 Mar 2023 20,533

llm-interface

A simple NPM interface for seamlessly interacting with 36 Large Language Model (LLM) providers, i...

12 Jun 2024 69

astra-assistants-api

Drop in replacement for the OpenAI Assistants API

15 Nov 2023 142

kani

kani (カニ) is a highly hackable microframework for chat-based language models with tool use/functi...

14 Jul 2023 556

api-for-open-llm

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, L...

23 May 2023 2,330

h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports...

24 Mar 2023 10,805

langroid

Harness LLMs with Multi-Agent Programming

16 Apr 2023 2,370