TY - JOUR
T1 - ARPG+
T2 - a simulation-based study of real-time coaching for educational LLM prompting
AU - Ye, Pei Gen
AU - Mo, Kanghua
AU - Long, Yucheng
AU - Liu, Mengyun
AU - Sang, Haiwei
AU - Zheng, Jun
N1 - Publisher Copyright:
© The Author(s) 2026.
PY - 2026/12
Y1 - 2026/12
N2 - Despite widespread adoption of large language models (LLMs), most students cannot effectively prompt them. The core challenge is teaching students how to ask: transforming prompting from trial-and-error guessing into a systematic, transferable skill. Existing solutions, such as static templates, rule-based hints, and automated rewriting, either ignore individual learning needs or optimize outputs without building competence, leaving students dependent and unable to generalize. ARPG+ is a real-time coaching system grounded in cognitive load theory and zone of proximal development that senses when learners struggle, delivers calibrated just-in-time interventions, and fades support as skills develop. The system tracks learner capability with uncertainty quantification, estimates cognitive overload from behavioral signals, diagnoses prompt quality across six dimensions, and adapts scaffolding intensity through a dynamic schedule with periodic skill probes. A lightweight-deep dual architecture ensures fast responsiveness for routine interactions while reserving richer analysis for critical moments. Evaluation with simulated learners shows ARPG+ produces improvements: prompt quality increases 143% beyond unguided practice, learners achieve independence in 91% of final interactions versus 59% under fixed support, and the approach generalizes to other domains without retraining. Our work establishes that principled real-time coaching can improve prompt quality, accelerate learning, prevent cognitive overload, and foster durable autonomy. All reported evaluations are conducted on LLM-based simulated learners; the present work does not yet constitute empirical validation with real students, and classroom validation in authentic educational settings is identified as a necessary subsequent step.
AB - Despite widespread adoption of large language models (LLMs), most students cannot effectively prompt them. The core challenge is teaching students how to ask: transforming prompting from trial-and-error guessing into a systematic, transferable skill. Existing solutions, such as static templates, rule-based hints, and automated rewriting, either ignore individual learning needs or optimize outputs without building competence, leaving students dependent and unable to generalize. ARPG+ is a real-time coaching system grounded in cognitive load theory and zone of proximal development that senses when learners struggle, delivers calibrated just-in-time interventions, and fades support as skills develop. The system tracks learner capability with uncertainty quantification, estimates cognitive overload from behavioral signals, diagnoses prompt quality across six dimensions, and adapts scaffolding intensity through a dynamic schedule with periodic skill probes. A lightweight-deep dual architecture ensures fast responsiveness for routine interactions while reserving richer analysis for critical moments. Evaluation with simulated learners shows ARPG+ produces improvements: prompt quality increases 143% beyond unguided practice, learners achieve independence in 91% of final interactions versus 59% under fixed support, and the approach generalizes to other domains without retraining. Our work establishes that principled real-time coaching can improve prompt quality, accelerate learning, prevent cognitive overload, and foster durable autonomy. All reported evaluations are conducted on LLM-based simulated learners; the present work does not yet constitute empirical validation with real students, and classroom validation in authentic educational settings is identified as a necessary subsequent step.
KW - Adaptive scaffolding
KW - Cognitive load theory
KW - Human-AI interaction
KW - Large language models
KW - Real-time coaching
UR - https://www.scopus.com/pages/publications/105042096939
U2 - 10.1186/s41239-026-00606-9
DO - 10.1186/s41239-026-00606-9
M3 - Article
AN - SCOPUS:105042096939
SN - 2365-9440
VL - 23
JO - International Journal of Educational Technology in Higher Education
JF - International Journal of Educational Technology in Higher Education
IS - 1
M1 - 30
ER -