TZ
local timezone environmental variable to ensure correct date in baseprompt.Full Changelog: https://github.com/jasonacox/TinyLLM/compare/v0.14.0...v0.14.1
Published by jasonacox 8 months ago
PROMPT_RO=true
).Full Changelog: https://github.com/jasonacox/TinyLLM/compare/v0.13.0...v0.14.0
Published by jasonacox 8 months ago
WEAVIATE_HOST
to the address of the DB/rag
queries.ONESHOT
environmental variable that if True
will remove conversation threading allowing each query to be answered as a standalone sessions.RAG_ONLY
environmental variable that if True
will assume all queries should be directed to the default RAG database as set by WEAVIATE_LIBRARY
.docker run \
-d \
-p 5000:5000 \
-e PORT=5000 \
-e OPENAI_API_BASE="http://localhost:8000/v1" \
-e ONESHOT="true" \
-e RAG_ONLY="false" \
-e WEAVIATE_HOST="localhost" \
-e WEAVIATE_LIBRARY="tinyllm" \
-v $PWD/.tinyllm:/app/.tinyllm \
--name chatbot \
--restart unless-stopped \
jasonacox/chatbot
Full Changelog: https://github.com/jasonacox/TinyLLM/compare/v0.12.5...v0.13.0
Published by jasonacox 8 months ago
chat.py
CLI chatbot to handle user/assistant prompts for vLLM.Published by jasonacox 8 months ago
chat.py
CLI chatbot to handle user/assistant prompts for vLLM.Full Changelog: https://github.com/jasonacox/TinyLLM/compare/v0.12.3...v0.12.4
Published by jasonacox 9 months ago
handle_url_prompt()
to extract text from URL.Full Changelog: https://github.com/jasonacox/TinyLLM/compare/v0.12.2...v0.12.3
Published by jasonacox 9 months ago
aiohttp
./news
command.Full Changelog: https://github.com/jasonacox/TinyLLM/compare/v0.12.0...v0.12.2
Published by jasonacox 9 months ago
?format=json
)prompts.json
and Sentence Transformer model location to a ./.tinyllm
for Docker support.Published by jasonacox 9 months ago
/stats
URL to Chatbot for settings and current status information.prompts.json
and Sentence Transformer models into .tinyllm
directory.Full Changelog: https://github.com/jasonacox/TinyLLM/compare/v0.11.3...v0.11.4
Published by jasonacox 9 months ago
POST /alert
)Full Changelog: https://github.com/jasonacox/TinyLLM/commits/v0.11.3