Uncertainty-aware Deep Reinforcement Learning for Trainable Equivalent Consumption Minimization Strategy of Fuel Cell Hybrid Electric Tracked Vehicle

Qicong Su, Ruchen Huang, Zhendong Zhang, Yiwen Shou, Hongwen He*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Energy management strategies (EMSs) are pivotal in optimizing energy efficiency for vehicles equipped with hybrid electric powertrains. Despite the growing adoption of deep reinforcement learning (DRL)-based approaches, challenges persist in achieving satisfactory optimization performance and maintaining reliable control. Motivated by this, this paper introduces a novel trainable equivalent consumption minimization strategy (ECMS) framework for fuel cell hybrid electric tracked vehicles (FCHETVs) with uncertainty-aware control. Firstly, the proposed framework employs a DRL algorithm to dynamically determine and optimize the equivalent factor in the ECMS method, facilitating improved fuel economy. Then, the soft actor-critic (SAC) algorithm is formulated for efficient policy learning. To further enhance control reliability, an ensembled policy network method is incorporated to measure uncertainty and mitigate suboptimal actions, thereby improving decision-making robustness. Simulation results reveal that the SAC-based trainable ECMS achieves significant fuel economy improvements, outperforming the traditional SAC and adaptive ECMS methods by 2.93% and 5.15% respectively. Moreover, the ensemble model ensures reliable and effective control, with online testing results indicating an additional 2.08% improvement in fuel economy. These findings underscore the effectiveness of integrating learning-based and optimization-based approaches in EMS design, offering a robust pathway to reducing energy consumption and promoting sustainable transportation solutions.

Original languageEnglish
JournalIEEE Transactions on Transportation Electrification
DOIs
Publication statusAccepted/In press - 2025

Keywords

  • deep reinforcement learning
  • Energy management
  • ensembled policy network
  • equivalent consumption minimization strategy
  • soft actor-critic

Cite this