Solutions to exercises in Reinforcement Learning: An Introduction (2nd Edition).
This repository contains my answers to exercises and programming problems from the Reinforcement Learning: An Introduction. I'm not sure if it's a good idea to make the solutions public because authors' intention is clearly the opposite. Despite initially not liking it, I have to admit it's a brilliant decision. Not having the answers easily available makes one think of creative ways to check whether the idea he just came up with is correct. The sanity checking process frequently reveals much more about the topic than working out the answer.
On the other hand, Googling for the answer helped me to get unstuck in many cases. So it would be selfish of me not to return the favor to others. The answers tend to be are scattered all over the internet and it seems like there's no single place to look them up. Besides, formulation of many of the programming problems is very deceiving. Initially it looks like an innocent, hour long, fun, coding challenge. But more often than not it turns into a weekend long wrestling with the pig in the mud :)
If you see a wrong answer, please, let me know by opening an issue. All the programming problems use OpenAI gym as the API between the agent and the environment. So checking the documentation may help to get a faster start. The code is written in Python 3 and uses numpy library for vectorized linear algebra operations.
chapter02.pdf
exercise02-05.ipynb
exercise02-11.ipynb
chapter04.pdf
exercise04-07.ipynb
exercise04-09.ipynb
chapter05.pdf
exercise05-12.ipynb
chapter06.pdf
exercise06-09.ipynb
exercise06-10.ipynb
chapter07.pdf
exercise07-02.ipynb
exercise07-10.ipynb
chapter08.pdf
exercise08-04.ipynb
exercise08-08.ipynb
exercise11-03.ipynb
chapter11.pdf