AsyncIO serving for data science models
BSD-3-CLAUSE License
A simple RAG chatbot that can retrieve from a mediawiki data dump
Expose tensorflow-lite models via a rest API using FastAPI
In this repository, I will share some useful notes and references about deploying deep learning-b...
TensorFlow as a Service, a general purpose framework to serve TF models.
ModelFox makes it easy to train, deploy, and monitor machine learning models.
GPT-powered chat for documentation, chat with your documents
A flexible, high-performance serving system for machine learning models
TF Serving demos
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use...
Start a data science project with modern tools
The little ASGI framework that shines. 🌟
Bootstrap a server from llama-cpp in a few lines of python
Explore large language models in 512MB of RAM