AI models as scalable microservices, enabling evaluation of LLMs and offering end-to-end functions such as chatbot, semantic search, image generation and beyond.
MIT License
Artificial Intelligence Infrastructure-as-Code Generator.
WebUI for Fine-Tuning and Self-hosting of Open-Source Large Language Models for Coding
Drop in replacement for the OpenAI Assistants API
A simple NPM interface for seamlessly interacting with 36 Large Language Model (LLM) providers, i...
APIs aggregator for inference, fine-tuning and build models.
AI Screen Analyzer allows users to capture screenshots, analyze them using various AI providers a...
Wingman is the fastest and easiest way to run Llama models on your PC or Mac.
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
Private Open AI on Kubernetes
Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference giv...
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable fo...
Create chatbot and AI agent workflows with unified access.
All-in-one AI CLI tool featuring Chat-REPL, Shell Assistant, RAG, AI tools & agents, with access ...
✨ Fully autonomous AI Agent that can perform complicated tasks and projects using terminal, brows...
A high-performance inference system for large language models, designed for production environments.