Control 3D Virtual Character through Tensroflow.js Posenet
MIT License
Personal Project
Note: Master Branch
contains functionalities only for head movements. Experimental Branch
contains functionalities for arms movements as well; however, the functionalities for arms movements do not work well enough to be added to Master Branch
yet.
This web app is an experiment to combine Machine Learning and Computer Graphics through TensorFlow.js and BabylonJS. Tensorflow.js is an official Javascript API of Google's popular machine learning framework Tensorflow, and since Tensorflow.js is a Javscript library, it provides a way to run machine learning models in browser environments. On the other hand, BabylonJS is a 3D engine that lets you create and run 3D graphics in web apps.
app.js
- main React appposenet.js
- class for running Tensorflow.js and Posenetgraphics.js
- class for running BabylonJS and creating the 3D scenejoints.js
, transform.js
- miscellaneous classesyarn
yarn watch
MIT