Skip to main navigation Skip to search Skip to main content

AutoUE: Automated Generation of 3D Games in Unreal Engine via Multi-Agent Systems

  • Beijing Institute of Technology
  • Beijing Jiaotong University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Automatically generating 3D games in commercial game engines remains a non-trivial challenge, as it involves complex engine-related workflows for generating assets such as scenes, blueprints, and code. To address this challenge, we propose a novel multi-agent system, AutoUE, which coordinates multiple agents to end-to-end generate 3D games, covering model retrieval, scene generation, gameplay and interaction code synthesis, and automated game testing for evaluation. In order to mitigate tool-use hallucinations in LLMs, we introduce a retrieval-augmented generation mechanism that grounds agents with relevant UE tool documentation. Additionally, we incorporate game design patterns and engine constraints into the code generation process to ensure the generation of correct and robust code. Furthermore, we design an automated play-testing pipeline that generates and executes runtime test commands, enabling systematic evaluation of dynamic behaviors. Finally, we construct a game generation dataset and conduct a series of experiments that demonstrate AutoUE’s ability to generate 3D games end-to-end, and validate the effectiveness of these designs.1

Original languageEnglish
Title of host publication64th Annual Meeting of the Association for Computational Linguistics, Findings of the Association for Computational Linguistics
Subtitle of host publicationACL 2026
EditorsMaria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
PublisherAssociation for Computational Linguistics (ACL)
Pages2341-2364
Number of pages24
ISBN (Electronic)9798891763951
Publication statusPublished - 2026
Event64th Annual Meeting of the Association for Computational Linguistics, ACL 2026 - San Diego, United States
Duration: 2 Jul 2026 → 7 Jul 2026

Publication series

NameProceedings of the Annual Meeting of the Association for Computational Linguistics
ISSN (Print)0736-587X

Conference

Conference64th Annual Meeting of the Association for Computational Linguistics, ACL 2026
Country/TerritoryUnited States
CitySan Diego
Period2/07/26 → 7/07/26

Fingerprint

Dive into the research topics of 'AutoUE: Automated Generation of 3D Games in Unreal Engine via Multi-Agent Systems'. Together they form a unique fingerprint.

Cite this