automated-playtesting technique sourced
Agent-based automated playtesting and balancing
Studios train imitation, reinforcement learning, and search agents to play builds, estimating level difficulty, pass and churn rates, progression pacing, map coverage, and exploits before players reach them.
mechanism
Agents play the game through an API or the rendered screen, in three families. Human-like agents are trained by supervised imitation of logged player moves, as with King's CNN on Candy Crush data, and their success rate on a new level predicts its difficulty for people. Goal-driven search or RL agents (A*, evolution strategies, deep RL) optimize task completion, and their action counts and success rates measure progression balance, as in EA's career-balancing study for The Sims Mobile. Curiosity agents are rewarded for novel states, maximizing map coverage to find stuck spots, missing collision, and unintended shortcuts. Agent results can feed a model of the player population: Roohi et al. combined RL agent pass rates with simulated skill, persistence, and boredom to predict per-level churn. In production, agents run against new builds inside the existing test pipeline and their coverage and failures are visualized for designers.
limitations
- Agents are not players: skill and style differ, and imitation agents need large logs of real player moves, which a new game lacks before launch.
- Integration dominates cost: EA SEED found engineering RL into production builds was the largest time sink, partly because development builds differ from the shipped game.
- Deep RL transfers poorly between games without heavy hyperparameter tuning, so cost grows roughly linearly with the number of titles.
- Open-ended simulation games have no single goal to optimize, so coverage or curiosity rewards stand in for design intent and can miss balance problems that only appear over long play.
relations
7 stored edgesAdaptive threat scaling
Agent pass rates plus a player-population model estimate how a difficulty ramp drives churn, so threat and difficulty curves can be tuned before release instead of from live telemetry.
Agent pathfinding
Curiosity and RL agents explore traversal exhaustively, finding stuck spots, missing collision, and shortcuts that scripted navmesh bots do not reach.
Career ladder
Search agents measure how many actions each career path needs to reach each level, exposing careers that are much faster or slower than the rest, as in The Sims Mobile study.
Milestone unlocks
Agents replaying the early game measure when resource and progression thresholds are reached, so unlock pacing is set from distributions instead of a few manual runs.
Scenario objectives
Each scenario or level gets a predicted pass rate from human-like agents, letting designers order and adjust goals and constraints against a target difficulty curve.
Statistical combat resolution
Agent playthroughs estimate win rates and dominant unit mixes in statistical combat before release.
backlinks
computed from other recordsclaims
6 with sourcesKing's CNN trained on player moves in Candy Crush Saga and Candy Crush Soda Saga predicted human moves and level difficulty, correlating better with average difficulty than MCTS at a fraction of the compute (IEEE CIG 2018).
EA used A* and evolution-strategy agents to balance The Sims Mobile careers during development and reported that deep RL needed heavy per-game tuning, so effort grew roughly linearly with the number of target games.
EA SEED's RL test agents found a wall missing its collision mesh that scripted navmesh agents missed and located all five stuck areas in a test map, and curiosity rewards raised coverage of a complex 3D map.
src-bergdahl-2020-augmenting-automated-testing-drl, src-gordillo-2021-curiosity-playtesting
EA SEED added an experimental RL system to scripted-bot automated testing for AAA titles including Battlefield 2042 and Dead Space (2023) and reported that integration, not algorithms, consumed the most time.
RL agents combined with a player-population model of skill, persistence, and boredom predicted per-level pass and churn rates for Angry Birds Dream Blast.
SIMA 2 (2025) follows language instructions in commercial 3D games through screen input and virtual keyboard and mouse and transfers skills across games, but still struggles with long-horizon tasks, memory, and precise low-level control.