Craftax: A Lightning-Fast Benchmark for Open-Ended Reinforcement Learning

https://arxiv.org/abs/2402.16801

JAX rewrite of the Crafter survival-crafting game; up to 250x faster than the Python original; PPO for 1 billion interactions in under an hour on one GPU.

Massively parallel GPU simulation