Build LLM-enabled FastAPI applications without build configuration.
MIT License
Bot releases are hidden (Show)
Published by mirpo about 2 months ago
transformers
and llama-cpp-python
.SmolLM-135M.Q8_0.gguf
and gemma-2-2b-it.q8_0.gguf
models.ner
template to use AutoModelForCausalLM
and AutoTokenizer
.Bump version
Published by mirpo 4 months ago
Bumb
Published by mirpo 4 months ago
Package update
Published by mirpo 6 months ago
Published by mirpo 6 months ago
llama-cpp-python
is now using gguf files.Published by mirpo about 1 year ago
Published by mirpo about 1 year ago
Added Langchain template
Published by mirpo about 1 year ago
Add Natural language processing (NLP) template.
Published by mirpo about 1 year ago
Update documentation and welcome text.
Published by mirpo about 1 year ago
Initial version with hello_world template.