https://github.com/iaalm/llama-api-server

A OpenAI API compatible REST server for llama.

MIT License

Downloads
672
Stars
199
Committers
3
View Code on GitHub
Ecosystems: Llama

Bot releases are visible (Hide)

https://github.com/iaalm/llama-api-server - v0.3.5 Latest Release

Published by github-actions[bot] about 1 year ago

Full Changelog: https://github.com/iaalm/llama-api-server/compare/v0.3.4...v0.3.5

https://github.com/iaalm/llama-api-server - v0.3.4

Published by github-actions[bot] about 1 year ago

What's Changed

Full Changelog: https://github.com/iaalm/llama-api-server/compare/v0.3.3...v0.3.4

https://github.com/iaalm/llama-api-server - v0.3.3

Published by github-actions[bot] about 1 year ago

Full Changelog: https://github.com/iaalm/llama-api-server/compare/v0.3.2...v0.3.3

https://github.com/iaalm/llama-api-server - v0.2.3

Published by github-actions[bot] over 1 year ago

Full Changelog: https://github.com/iaalm/llama-api-server/compare/v0.2.2...v0.2.3

https://github.com/iaalm/llama-api-server - v0.2.2

Published by github-actions[bot] over 1 year ago

What's Changed

Full Changelog: https://github.com/iaalm/llama-api-server/compare/v0.2.1...v0.2.2

https://github.com/iaalm/llama-api-server - v0.2.1

Published by github-actions[bot] over 1 year ago

Full Changelog: https://github.com/iaalm/llama-api-server/compare/v0.2.0...v0.2.1

https://github.com/iaalm/llama-api-server - v0.2.0

Published by github-actions[bot] over 1 year ago

What's Changed

New Contributors

Full Changelog: https://github.com/iaalm/llama-api-server/compare/v0.1.3...v0.2.0

https://github.com/iaalm/llama-api-server - v0.1.3

Published by github-actions[bot] over 1 year ago

Full Changelog: https://github.com/iaalm/llama-api-server/compare/v0.1.2...v0.1.3

https://github.com/iaalm/llama-api-server - v0.1.2

Published by github-actions[bot] over 1 year ago

Full Changelog: https://github.com/iaalm/llama-api-server/compare/v0.1.1...v0.1.2

https://github.com/iaalm/llama-api-server - v0.1.1

Published by github-actions[bot] over 1 year ago

Full Changelog: https://github.com/iaalm/llama-api-server/commits/v0.1.1

https://github.com/iaalm/llama-api-server - v0.1.0

Published by iaalm over 1 year ago

Package Rankings
Top 18.71% on Pypi.org
Top 6.75% on Proxy.golang.org
Badges
Extracted from project README
Code style: black Release PyPI version
Related Projects
py-gpt

Desktop AI Assistant powered by GPT-4, GPT-4 Vision, GPT-3.5, Gemini, Claude, Llama 3, DALL-E, La...

09 Apr 2023 547
llama-server

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.

03 Apr 2023 111
llama-api

An OpenAI-like LLaMA inference API

20 Jul 2023 111
llama.go

llama.go is like llama.cpp in pure Golang!

19 Mar 2023 1,245
lightllm

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable fo...

22 Jul 2023 1,967
libre-chat

🦙 Free and Open Source Large Language Model (LLM) chatbot web UI and API. Self-hosted, offline ca...

26 Jul 2023 128
Llama-2-Open-Source-LLM-CPU-Inference

Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A

06 Jul 2023 945
llavavision

A simple "Be My Eyes" web app with a llama.cpp/llava backend

06 Nov 2023 482
ScaleLLM

A high-performance inference system for large language models, designed for production environments.

24 Jul 2023 289
llama

Inference code for Llama models

14 Feb 2023 53,568
botality-ii

telegram bot for self-hosted local inference of stable diffusion, text-to-speech and large langua...

11 Mar 2023 37
Llama-Chinese

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

19 Jul 2023 12,154
api-for-open-llm

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, L...

23 May 2023 2,330
llm-api

Run any Large Language Model behind a unified API

02 Apr 2023 159
pyllamacpp

Python bindings for llama.cpp

25 Apr 2023 62