TY - JOUR
T1 - Prediction-informed distributional deep reinforcement learning for energy management of fuel cell tracked vehicles
T2 - A hybrid control framework
AU - Su, Qicong
AU - Huang, Ruchen
AU - Shou, Yiwen
AU - Zhao, Xuyang
AU - He, Hongwen
N1 - Publisher Copyright:
© 2026
PY - 2026/12
Y1 - 2026/12
N2 - Energy management strategies (EMSs) play a pivotal role in promoting energy conservation of vehicles with hybrid energy storage systems, particularly for fuel cell tracked vehicles (FCTVs) operating under complex driving scenarios. While optimization-based and learning-based EMSs have gained significant research traction, fundamental challenges remain in achieving deeper methodological integration for enhanced control performance. To bridge this gap, this article develops a novel hybrid control framework that synergistically combines prediction-informed distributional deep reinforcement learning (DRL) with the equivalent consumption minimization strategy (ECMS) for FCTVs, delivering an intelligent and integrated energy management solution. Firstly, this integrated framework employs DRL for equivalent factor (EF) selection, while ECMS delivers optimization-grounded power allocation, collectively advancing fuel economy. Further elevating this approach, we employ Truncated Quantile Critics (TQC), an advanced distributional DRL algorithm engineered to refine EF precision and energy utilization efficiency. Moreover, a variational mode decomposition (VMD)-Transformer-based power demand prediction module is seamlessly integrated to empower prospective decision-making within the DRL paradigm. Experimental validation demonstrates that this predictor achieves 27.45%–36.07% higher power demand prediction accuracy than conventional baselines. The proposed framework reduces hydrogen consumption by 6.15% compared with the soft actor-critic-based EMS benchmark under the testing cycle. These results demonstrate the effectiveness of integrating prediction-informed DRL with ECMS for energy management of FCTVs.
AB - Energy management strategies (EMSs) play a pivotal role in promoting energy conservation of vehicles with hybrid energy storage systems, particularly for fuel cell tracked vehicles (FCTVs) operating under complex driving scenarios. While optimization-based and learning-based EMSs have gained significant research traction, fundamental challenges remain in achieving deeper methodological integration for enhanced control performance. To bridge this gap, this article develops a novel hybrid control framework that synergistically combines prediction-informed distributional deep reinforcement learning (DRL) with the equivalent consumption minimization strategy (ECMS) for FCTVs, delivering an intelligent and integrated energy management solution. Firstly, this integrated framework employs DRL for equivalent factor (EF) selection, while ECMS delivers optimization-grounded power allocation, collectively advancing fuel economy. Further elevating this approach, we employ Truncated Quantile Critics (TQC), an advanced distributional DRL algorithm engineered to refine EF precision and energy utilization efficiency. Moreover, a variational mode decomposition (VMD)-Transformer-based power demand prediction module is seamlessly integrated to empower prospective decision-making within the DRL paradigm. Experimental validation demonstrates that this predictor achieves 27.45%–36.07% higher power demand prediction accuracy than conventional baselines. The proposed framework reduces hydrogen consumption by 6.15% compared with the soft actor-critic-based EMS benchmark under the testing cycle. These results demonstrate the effectiveness of integrating prediction-informed DRL with ECMS for energy management of FCTVs.
KW - Distributional deep reinforcement learning
KW - Energy management
KW - Hybrid control framework
KW - Power demand prediction
KW - Truncated quantile critics
UR - https://www.scopus.com/pages/publications/105045946627
U2 - 10.1016/j.apenergy.2026.128534
DO - 10.1016/j.apenergy.2026.128534
M3 - Article
AN - SCOPUS:105045946627
SN - 0306-2619
VL - 425
JO - Applied Energy
JF - Applied Energy
M1 - 128534
ER -