TY - JOUR
T1 - Multi-Perception Crowd
T2 - Learning to combine entity and implicit perception for diverse crowd simulation
AU - Huang, Kexiang
AU - Argudo, Oscar
AU - Ding, Gangyi
AU - Pelechano, Nuria
N1 - Publisher Copyright:
© 1995-2012 IEEE.
PY - 2026
Y1 - 2026
N2 - We present a reinforcement learning framework for crowd simulation that balances collision avoidance with navigation preferences guided by soft environmental constraints. Our approach integrates two complementary perception components: entity perception, which handles hard constraints imposed by physical obstacles, and implicit environmental perception, encoded as suitability maps that guide movement preferences due to soft constraints. To ensure robust generalization across complex scenes, we employ a modular, two-phase training strategy utilizing curriculum-based environmental templates. The proposed framework functions as an intuitive crowd authoring tool: artists can influence crowd behavior in real time by interactively editing suitability maps or dynamically adjusting perception weights, either globally or per-agent. This enables adaptive navigation behaviors, such as dynamic trajectory prioritization based on the environment, to emerge from local interactions. We validate our approach using both quantitative metrics and qualitative analysis, including a user study confirming that the resulting behaviors align with pedestrian traffic patterns observed in real-world settings. We further present an example of emergent social behavior through the formation and gradual evolution of desire paths. This work contributes to the field of crowd simulation by offering a robust, learning-based framework that supports heterogeneous navigation modeling and intuitive authoring for interactive applications.
AB - We present a reinforcement learning framework for crowd simulation that balances collision avoidance with navigation preferences guided by soft environmental constraints. Our approach integrates two complementary perception components: entity perception, which handles hard constraints imposed by physical obstacles, and implicit environmental perception, encoded as suitability maps that guide movement preferences due to soft constraints. To ensure robust generalization across complex scenes, we employ a modular, two-phase training strategy utilizing curriculum-based environmental templates. The proposed framework functions as an intuitive crowd authoring tool: artists can influence crowd behavior in real time by interactively editing suitability maps or dynamically adjusting perception weights, either globally or per-agent. This enables adaptive navigation behaviors, such as dynamic trajectory prioritization based on the environment, to emerge from local interactions. We validate our approach using both quantitative metrics and qualitative analysis, including a user study confirming that the resulting behaviors align with pedestrian traffic patterns observed in real-world settings. We further present an example of emergent social behavior through the formation and gradual evolution of desire paths. This work contributes to the field of crowd simulation by offering a robust, learning-based framework that supports heterogeneous navigation modeling and intuitive authoring for interactive applications.
KW - Animations
KW - Crowd Authoring
KW - Crowd Simulation
KW - Reinforcement Learning
UR - https://www.scopus.com/pages/publications/105043593314
U2 - 10.1109/TVCG.2026.3707675
DO - 10.1109/TVCG.2026.3707675
M3 - Article
AN - SCOPUS:105043593314
SN - 1077-2626
JO - IEEE Transactions on Visualization and Computer Graphics
JF - IEEE Transactions on Visualization and Computer Graphics
ER -