A OpenAI API compatible REST server for llama.
MIT License
Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, L...
Inference code for Llama models
Run any Large Language Model behind a unified API
🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline ca...
telegram bot for self-hosted local inference of stable diffusion, text-to-speech and large langua...
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable fo...
Python bindings for llama.cpp
llama.go is like llama.cpp in pure Golang!
Desktop AI Assistant powered by GPT-4, GPT-4 Vision, GPT-3.5, Gemini, Claude, Llama 3, DALL-E, La...
An OpenAI-like LLaMA inference API
A simple "Be My Eyes" web app with a llama.cpp/llava backend
LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
A high-performance inference system for large language models, designed for production environments.
Llama中文社区,Llama3在线体验和微调模型已开放,实时汇总最新Llama3学习资料,已将所有代码更新适配Llama3,构建最好的中文Llama大模型,完全开源可商用