Replacing Real-Time the High-Resolution Meeting Background Freely.
# git clone https://github.com/Charmve/TimeWarp.git
# cd TimeWarp
# pip install -r requirements.txt
download dataset and model Download
run test code
# cd TimeWarp
# bash test_video.sh
# cd TimeWarp
# python3 test_image.py
➡️ Web Demo by Gradio: Matting your own images from your browser.
We provide several scripts in this repo for you to experiment with our model. More detailed instructions are included in the files.
inference_images.py
: Perform matting on a directory of images.inference_video.py
: Perform matting on a video.inference_webcam.py
: An interactive matting demo using your webcam.Additionally, you can try our notebooks in Google Colab for performing matting on images and videos.
We provide a demo application that pipes webcam video through our model and outputs to a virtual camera. The script only works on Linux system and can be used in Zoom meetings. For more information, checkout:
Developers in the community has helped us build a web demo. See Community Projects section below.
You can run our model using PyTorch, TorchScript, TensorFlow, and ONNX. For detail about using our model, please check out the Usage / Documentation page.
Training code will be released upon acceptance of the paper.
gantt
dateFormat YYYY-MM-DD
title TimeWarp Development Processing
section image matting
architecture design :done, des1, 2020-11-06,2020-12-20
video matting :active, des2, 2021-01-07, 3d
chrome extension plus : des3, after des2, 7d
video meeting architecture : des4, after des3, 5d
Business ✉️ email: [email protected]
GitHub discussions 💬 or issues 💭
QQ Group: 697948168 (password:TimeWarp)
Email: yidazhang1#gmail.com
[1] Real-Time High-Resolution Background Matting. Shanchuan Lin*, Andrey Ryabtsev*, Soumyadip Sengupta. [GitHub] | [arXiv] | [data]
[2] Background Matting: The World is Your Green Screen. Soumyadip Sengupta, Vivek Jayaram, Brian Curless, et.al. CVPR 2020. [GitHub] | [arXiv]
[3] MODNet: Is a Green Screen Really Necessary for Real-Time Portrait Matting? [GitHub] | [arXiv]
[4] High-Resolution Deep Image Matting. Haichao Yu, Ning Xu, Zilong Huang. [GitHub] | [arXiv]
[5] End-to-end Animal Image Matting. Jizhizi Li, Jing Zhang, Stephen J. Maybank. [GitHub] | [arXiv].
[6] BGMv2-webcam-plugin-linux. https://github.com/andreyryabtsev/BGMv2-webcam-plugin-linux
[7] Chrome-extensions-samples. https://github.com/GoogleChrome/chrome-extensions-samples
[8] Zoom Video Ingester. https://github.com/harvard-dce/zoom-recording-ingester
[9] Zoom Recording Downloader. https://github.com/ricardorodrigues-ca/zoom-recording-downloader
[10] PaperswithCode. Image Matting. https://paperswithcode.com/task/image-matting
This work is licensed under the Creative Commons Attribution NonCommercial ShareAlike 4.0 License.
Thanks for PeterL1n, et al.