Memory Gym: Partially Observable Challenges to
Memory-Based Agents in Endless Episodes

Memory Gym features the environments Mortar Mayhem, Mystery Path, and Searing Spotlights that are inspired by some mini games of Pummel Party. These environments shall benchmark an agent's memory to

Especially, these environments feature endless task variants. As the agent's policy improves, the task goes on. The traveling game "I packed my bag ..." inspired this dynamic concept, which allows for examining levels of effectiveness instead of just sample efficiency.

Github

Citation

@inproceedings{pleines2023memory,
title={Memory Gym: Partially Observable Challenges to Memory-Based Agents},
author={Marco Pleines and Matthias Pallasch and Frank Zimmer and Mike Preuss},
booktitle={International Conference on Learning Representations},
year={2023},
url={https://openreview.net/forum?id=jHc8dCx6DDr}
}

Experiments



TransformerXL
+ Reconstruction


Gated Recurrent Unit


Gated Recurrent Unit
+ Reconstruction


TransformerXL
+ Ground Truth

TransformerXL
+ QPos

TransformerXL
+ Ground Truth
+ QPos

Gated Recurrent Unit


TransformerXL
+ Reconstruction

Gated Recurrent Unit
+ Reconstruction


TransformerXL
+ Reconstruction

Gated Recurrent Unit
+ Reconstruction