跳到主要导航 跳到搜索 跳到主要内容

EduBench: A Comprehensive Benchmarking Dataset for Evaluating Large Language Models in Diverse Educational Scenarios

  • Bin Xu
  • , Yu Bai
  • , Huashan Sun
  • , Yiguan Lin
  • , Siming Liu
  • , Xinyue Liang
  • , Yaolin Li
  • , Zhuangzhi Dong
  • , Jingren Zhang
  • , Yufan Deng
  • , Xinyu Zou
  • , Yang Gao*
  • , Heyan Huang
  • *此作品的通讯作者
  • Beijing Institute of Technology
  • Beijing Academy of Artificial Intelligence

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

摘要

As large language models continue to advance, their application in educational contexts remains underexplored and under-optimized. In this paper, we address this gap by introducing the first diverse benchmark tailored for educational scenarios, incorporating synthetic data containing 9 major scenarios and over 4,000 distinct educational contexts. To enable comprehensive assessment, we propose a set of multi-dimensional evaluation rubrics that cover 12 critical aspects relevant to both teachers and students. We further apply human annotation to ensure the effectiveness of the model-generated evaluation responses. Additionally, we succeed to train a relatively small-scale model on our constructed dataset and demonstrate that it can achieve performance comparable to state-of-the-art large models (e.g., Deepseek V3, Qwen Max) on the test set. Overall, this work provides a practical foundation for the development and evaluation of education-oriented language models.

源语言英语
主期刊名Long Papers
编辑Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
出版商Association for Computational Linguistics (ACL)
页21615-21645
页数31
ISBN(电子版)9798891763906
DOI
出版状态已出版 - 2026
已对外发布是
活动64th Annual Meeting of the Association for Computational Linguistics, ACL 2026 - San Diego, 美国
期限: 2 7月 2026 → 7 7月 2026

丛书

姓名Proceedings of the Annual Meeting of the Association for Computational Linguistics
卷1
ISSN(印刷版)0736-587X

会议

会议64th Annual Meeting of the Association for Computational Linguistics, ACL 2026
国家/地区美国
市San Diego
时期2/07/26 → 7/07/26

学术指纹

探究 'EduBench: A Comprehensive Benchmarking Dataset for Evaluating Large Language Models in Diverse Educational Scenarios' 的科研主题。它们共同构成独一无二的学术指纹。

引用此