Caffe code to accompany my Tutorial on Variational Autoencoders
MIT License
This code is a supplement to the Tutorial on Variational Autoencoders. It allows you to reproduce the example experiments in the tutorial's later sections.
This code contains two demos. The first is a standard Variational Autoencoder (VAE) for MNIST. The second is a Conditional Variational Autoencoder (CVAE) for reconstructing a digit given only a noisy, binarized column of pixels from the digit's center. For details on the experimental setup, see the paper.
No additional Caffe layers are needed to make a VAE/CVAE work in Caffe. The only requirements are a working Caffe/pycaffe installation. A GPU will make the experiments run faster, but is not necessary (comment out set_mode_gpu() in the python files if you don't have one). On my system (a Titan X), these experiments all complete in about 10 minutes.
The code will generate a network drawing, but for convenience I've included the result of that drawing here. This is for the VAE:
Here is a side-by-side comparison between the CVAE and regressor which solve the same problem. Note that both networks have several initial layers for constructing the input and output data that's used to train the network.
Install Caffe (see: Caffe installation instructions). Build Caffe
and pycaffe
. For this readme, we'll call the installation path $CAFFE_PATH.
Clone this repo. For this readme, we'll call the installation path $TUTORIAL_PATH
git clone https://github.com/cdoersch/vae_tutorial.git
cd $CAFFE_PATH/data/mnist/
./get_mnist.sh
cd $CAFFE_PATH/
./examples/mnist/create_mnist.sh
cd $TUTORIAL_PATH
ln -s [...] snapshots
Edit mnist_vae.prototxt and enter the correct "source" path to the training lmdb (line 13)
Run the code. Make sure $CAFFE_PATH/python is on your PYTHONPATH.
cd $TUTORIAL_PATH
python mnist_vae.py
Note that the python is only required for generating the visualizations: the net can also be trained simply by calling
$CAFFE_PATH/build/tools/caffe train --solver=mnist_vae_solver_adam.prototxt
Edit mnist_cvae.prototxt and enter the correct "source" path for BOTH training and testing lmdb's (line 13 AND 29)
Run the code. Make sure $CAFFE_PATH/python is on your PYTHONPATH.
cd $TUTORIAL_PATH
python mnist_cvae.py
Note that the python is only required for generating the visualizations: the net can also be trained simply by calling
$CAFFE_PATH/build/tools/caffe train --solver=mnist_cvae_solver_adam.prototxt
cd $TUTORIAL_PATH
python mnist_regressor.py