Convert text and audio to facial expressions
MIT License
Convert text and audio to facial expressions
python3.10 -m venv venv
echo $(pwd) > venv/lib/python3.10/site-packages/module.pth
. venv/bin/activate
pip install -r requirements.txt -r requirements-dev.txt
artefact/best-lips.pt
streamlit run app.py
lrs3_v0.4
directoryvideo/{id}.mp4
where id is the query parameter v
noisy
directorypython lrs3_v0.4/preprocess.py
docker-compose -f landmark/docker-compose.yml up
clean
directorypython lrs3_v0.4/postprocess.py
The clean
directory contains sample data that have been preprocessed. You may use it to reproduce our model.
python train.py
Call trained model with text input.
python score.py --text "Hello World!"
Video will be saved as output/line_0.mp4