Training Agents Inside of Scalable World Models

https://arxiv.org/abs/2509.24527

Dreamer 4 learns behavior by RL inside a world model trained mostly on unlabeled video; model runs interactively on one GPU; first agent to obtain Minecraft diamonds from offline data only.

Self-play planning with learned models (AlphaZero, MuZero, Dreamer)