llm-api

A fast CPU-based API for OpenChat 3.6 using CTranslate2, hosted on Hugging Face Spaces.

Stars
0
Committers
4
View Code on GitHub Visit Website
Ecosystems: Docker, FastAPI

Commit Statistics

Past Year

All Time

Total Commits
147
147
Total Committers
4
4
Avg. Commits Per Committer
36.75
36.75
Bot Commits
110
110

Issue Statistics

Past Year

All Time

Total Pull Requests
100
100
Merged Pull Requests
87
87
Total Issues
0
0
Time to Close Issues
N/A
N/A
Badges
Extracted from project README
linting: pylint build.yml deploy.yml formatter.yml warmer.yml dependabot.yml Open in Spaces Open a Pull Request
Related Projects
Examplify

An offline CPU-first memory-scarce chat application to perform RAG on your corpus of data. Powere...

27 Sep 2023 12
serge

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use...

19 Mar 2023 5,614
nllb-api

A low-memory high-performance CPU-based API for Meta's No Language Left Behind (NLLB) using CTran...

27 May 2023 45
tectonic-api

A simple axum API for compiling TeX/LaTeX with Tectonic, hosted on Hugging Face Spaces.

29 Jun 2023 0
api-for-open-llm

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, L...

23 May 2023 2,330
CapGen

A fast CPU-first video/audio transcriber for generating caption files with Whisper and CTranslate...

16 Sep 2023 1
tokeniser-api

A high-performance axum API for serving Hugging Face's Tokenizers

16 May 2024 0