跳到主要导航 跳到搜索 跳到主要内容

AutoUE: Automated Generation of 3D Games in Unreal Engine via Multi-Agent Systems

  • Beijing Institute of Technology
  • Beijing Jiaotong University

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

摘要

Automatically generating 3D games in commercial game engines remains a non-trivial challenge, as it involves complex engine-related workflows for generating assets such as scenes, blueprints, and code. To address this challenge, we propose a novel multi-agent system, AutoUE, which coordinates multiple agents to end-to-end generate 3D games, covering model retrieval, scene generation, gameplay and interaction code synthesis, and automated game testing for evaluation. In order to mitigate tool-use hallucinations in LLMs, we introduce a retrieval-augmented generation mechanism that grounds agents with relevant UE tool documentation. Additionally, we incorporate game design patterns and engine constraints into the code generation process to ensure the generation of correct and robust code. Furthermore, we design an automated play-testing pipeline that generates and executes runtime test commands, enabling systematic evaluation of dynamic behaviors. Finally, we construct a game generation dataset and conduct a series of experiments that demonstrate AutoUE’s ability to generate 3D games end-to-end, and validate the effectiveness of these designs.1

源语言英语
主期刊名64th Annual Meeting of the Association for Computational Linguistics, Findings of the Association for Computational Linguistics
主期刊副标题ACL 2026
编辑Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
出版商Association for Computational Linguistics (ACL)
页2341-2364
页数24
ISBN(电子版)9798891763951
出版状态已出版 - 2026
活动64th Annual Meeting of the Association for Computational Linguistics, ACL 2026 - San Diego, 美国
期限: 2 7月 2026 → 7 7月 2026

丛书

姓名Proceedings of the Annual Meeting of the Association for Computational Linguistics
ISSN(印刷版)0736-587X

会议

会议64th Annual Meeting of the Association for Computational Linguistics, ACL 2026
国家/地区美国
市San Diego
时期2/07/26 → 7/07/26

学术指纹

探究 'AutoUE: Automated Generation of 3D Games in Unreal Engine via Multi-Agent Systems' 的科研主题。它们共同构成独一无二的学术指纹。

引用此