A set of high-dimensional continuous control environments for use with Unity ML-Agents Toolkit.
MarathonEnvs is a set of high-dimensional continuous control benchmarks using Unitys native physics simulator, PhysX. MarathonEnvs can be trained using Unity ML-Agents or any OpenAI Gym compatible algorithm. MarathonEnvs may be useful for:
Note: This project is the result of contributions from members of the Unity community (see below) who actively maintain the repository. As such, the contents of this repository are not officially supported by Unity Technologies.
Need Help?
Controller (DReCon) - Preview | |
---|---|
A controller based agent, inspired by the DReCon paper (link below). The agent learns to follow a simple traditional controller agent and exhibits emergent behavior. In Preview ControllerMarathonMan-v0 | |
Style Transfer (DeepMimic) | |
Learning from motion capture examples, inspired by the DeepMimic paper (link below). The agent learns the motion capture sequence using a phase value. MarathonManWalking-v0MarathonManRunning-v0arathonManJazzDancing-v0MarathonManMMAKick-v0MarathonManPunchingBag-v0MarathonManBackflip-v0 | |
Procedural Environments | |
Procedurally-generated terrains aimed at addressing overfitting in Reinforcement Learning and generalizable skills.TerrainHopper-v0TerrainWalker2d-v0TerrainAnt-v0TerrainMarathonMan-v0 | |
Classical Environments | |
Classical implementations of Ant, Hopper, Walker-2d, HumanoidHopper-v0Walker2d-v0Ant-v0MarathonMan-v0 | |
Sparse - Experimental | |
Sparse reward version of a humanoid learning to walk. The agent recives a single reward at the end of the episode.MarathonManSparse-v0 |
The latest version is v3.0.0
The following table lists releases, the required unity version, and links to release note, source code, and binaries:
Version | Unity | Updated Environments | Source | MacOS | Windows | Linux | Web | Paper |
---|---|---|---|---|---|---|---|---|
master (unstable) | 2020.1 | ControllerMarathonMan-v0 | -- | -- | -- | -- | -- | -- |
v3.0.0 | 2020.1 beta.12 | ControllerMarathonMan-v0 | Source | MacOS | -- | Linux | Web | arXiv |
v2.0.0 | 2018.4 LTS | MarathonManWalking-v0 MarathonManRunning-v0 MarathonManJazzDancing-v0 MarathonManMMAKick-v0 MarathonManPunchingBag-v0 | Source | MacOS | -- | Linux | -- | -- |
v2.0.0-alpha.2 | 2018.4 LTS | -- | Source | MacOS | Windows | Linux | -- | AAAI 2019 |
v2.0.0-alpha.1 | 2018.4 LTS | MarathonManBackflip-v0 MarathonMan-v0 ManathonManSparse-v0 TerrainHopperEnv-v0, TerrainWalker2dEnv-v0, TerrainAntEnv-v0, TerrainMarathonManEnv-v0 | Source | -- | -- | -- | -- | -- |
v0.5.0a | 2018.2 | Hopper-v0, Walker2d-v0, Ant-v0, Humanoid-v0 | Source | -- | -- | -- | -- | Blog |
pip3 install mlagents==0.14.1
envs\
folderVideo walkthrough:-
Getting started with Marathon Environments v0.5.0a BLOG
If you use MarathonEnvs in your research, we ask that you please cite our paper.