LLM Chat is an open-source serverless alternative to ChatGPT.
MIT License
GenAI Chat is an open-source serverless alternative to ChatGPT.
There are plenty of open source alternatives like chatwithgpt.ai. The goal of this particular project was to make a version that:
This comes at the cost of:
At a high level:
DATABASE_URL (from cockroachlabs)
OPENAI_API_KEY (from openai)
llm-chat-secret
# Required
DATABASE_URL (from cockroachlabs)
HUGGING_FACE_HUB_TOKEN (from huggingface)
OPENAI_API_KEY (from openai)
# Semi Optional
SERPER_API_KEY (from https://serper.dev/)
WOLFRAM_ALPHA_APPID (https://developer.wolframalpha.com/)
# Semi Optional File Storage (uses imgur if provided or falls back to s3)
IMGUR_CLIENT_ID
AWS_ACCESS_KEY_ID
AWS_SECRET_ACCESS_KEY
AWS_BUCKET_NAME
ELEVEN_API_KEY
cd modal && modal deploy modalapp
cd modal && python scripts/create_user.py --name "John Smith"
src\backend.js
with deployed modal endpoint (API_ENDPOINT
) OR use ?backend=<modal endpoint>
in the URL at chat.sshh.io
.<netlify site>/?key=<API key>
Note that plugins are only supported for openai functions agents.
Just add a new function to /modal/tools/tools.py
.
models/chat_hf_inference.py
and adjust to whatever model you want