llama-api-server

A OpenAI API compatible REST server for llama.

MIT License

Downloads
672
Stars
199
Committers
3
View Code on GitHub
Ecosystems: Llama

Bot releases are hidden (Show)

llama-api-server - v0.1.0

Published by iaalm over 1 year ago

Package Rankings
Top 18.71% on Pypi.org
Top 6.75% on Proxy.golang.org
Badges
Extracted from project README
Code style: black Release PyPI version
Related Projects
llama-server

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.

03 Apr 2023 111
llama-api

An OpenAI-like LLaMA inference API

20 Jul 2023 111
libre-chat

🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline ca...

26 Jul 2023 128
py-gpt

Desktop AI Assistant powered by GPT-4, GPT-4 Vision, GPT-3.5, Gemini, Claude, Llama 3, DALL-E, La...

09 Apr 2023 547
lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable fo...

22 Jul 2023 1,967
llama

Inference code for Llama models

14 Feb 2023 53,568
ScaleLLM

A high-performance inference system for large language models, designed for production environments.

24 Jul 2023 289
Llama-2-Open-Source-LLM-CPU-Inference

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

06 Jul 2023 945
llm-api

Run any Large Language Model behind a unified API

02 Apr 2023 159
api-for-open-llm

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, L...

23 May 2023 2,330
pyllamacpp

Python bindings for llama.cpp

25 Apr 2023 62
botality-ii

telegram bot for self-hosted local inference of stable diffusion, text-to-speech and large langua...

11 Mar 2023 37
Llama-Chinese

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

19 Jul 2023 12,154
llama.go

llama.go is like llama.cpp in pure Golang!

19 Mar 2023 1,245
llavavision

A simple "Be My Eyes" web app with a llama.cpp/llava backend

06 Nov 2023 482