[Work In Progress] Server/Cloud-ready FastChat Docker images.
AGPL-3.0 License
Server/Cloud-ready FastChat Docker image based either on Nvdidia CUDA Ubuntu image including:
This image is intented for people who want to run FastChat using on their own server or cloud instance.
Docker Hub prebuilt images are automatically updated on a daily basis.
Dockerfile
linksdocker run --entrypoint ...
or a Docker Compose file via entrypoint: [...]
.Dockerfile
linksPORT
REQUIRED
This is the server exposed port to emit and listen socket events.
This repository provides a few convenience scripts to install and run FastChat without using Docker, for better performances:
debian.sh
: Copy this file in your /home/[username]
directory and run it from this directory via sh ./debian.sh
.X
is FastChat version:
latest
: clone the main
branch from FastChat repository
Z
is the variant tag:
cuda12
: NVidia GPUsmake build-X-Z
Example: make build-latest-cuda12
.
make run-X
# or:
make run-X-Z
Example: make run-latest-cuda12
.