mistral-chat-f16
Simple chat application with Nx, streaming and Mistral 7B f16 using the latest bumblebee
Stars
2
Ecosystems:
Elixir
Chat
To start your Phoenix server:
- Run
mix setupto install and setup dependencies - Start Phoenix endpoint with
mix phx.serveror inside IEx withiex -S mix phx.server
Now you can visit localhost:4000 from your browser.
Ready to run in production? Please check our deployment guides.
Learn more
- Official website: https://www.phoenixframework.org/
- Guides: https://hexdocs.pm/phoenix/overview.html
- Docs: https://hexdocs.pm/phoenix
- Forum: https://elixirforum.com/c/phoenix-forum
- Source: https://github.com/phoenixframework/phoenix
Deploy to fly with GPU
fly apps create chat1999
fly secrets set SECRET_KEY_BASE=2G+abc7fd49ktnGX9ay+e2StgxxH9ts+t5/i/MnNkc7wa5S38zLHRHoBic3SbXEQ
fly deploy --ha=false