api-for-open-llm

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc. 开源大模型的统一后端接口

APACHE-2.0 License

Stars
2.3K
Committers
14
View Code on GitHub
Ecosystems: Llama, Langchain, Docker
api-for-open-llm - latest Latest Release

Published by xusenlinzy 5 months ago

  • 升级vllm版本

  • 支持GLM4和QWEN2系列模型

api-for-open-llm - latest

Published by xusenlinzy 9 months ago

some fix

api-for-open-llm - latest

Published by xusenlinzy 10 months ago

api-for-open-llm - api-for-open-llm-v1.0.2

Published by xusenlinzy 11 months ago

  • Add support for llama-cpp-python

  • Add DeepSeek, Yi template

  • Refactor project

api-for-open-llm - api-for-open-llm-v1.0.1

Published by xusenlinzy 11 months ago

fix bug

api-for-open-llm - api-for-open-llm-v1.0.0

Published by xusenlinzy 12 months ago

openai>=1.2.0

api-for-open-llm - api-for-open-llm-v0.0.5

Published by xusenlinzy 12 months ago

master分支

openai<=0.28.0

api-for-open-llm - api-for-open-llm-v0.0.4

Published by xusenlinzy about 1 year ago

  • Update streamlit demo

  • Add support for repetition penalty

  • Add support for baichuan2 models

api-for-open-llm -

Published by xusenlinzy about 1 year ago

api-for-open-llm - api-for-open-llm-v0.0.2

Published by xusenlinzy about 1 year ago

api-for-open-llm - v0.0.1

Published by xusenlinzy about 1 year ago

Package Rankings
Top 6.75% on Proxy.golang.org
Badges
Extracted from project README
Star History Chart