TY - JOUR
T1 - Energy management for a hybrid electric vehicle based on prioritized deep reinforcement learning framework
AU - Du, Guodong
AU - Zou, Yuan
AU - Zhang, Xudong
AU - Guo, Lingxiong
AU - Guo, Ningyuan
N1 - Publisher Copyright:
© 2021 Elsevier Ltd
PY - 2022/2/15
Y1 - 2022/2/15
N2 - A novel deep reinforcement learning (DRL) control framework for the energy management strategy of the series hybrid electric tracked vehicle (SHETV) is proposed in this paper. Firstly, the powertrain model of the vehicle is established, and the formulation of the energy management problem is given. Then, an efficient deep reinforcement learning framework based on the double deep Q-learning (DDQL) algorithm is built for the optimal problem solving, which also contains a modified prioritized experience replay (MPER) and an adaptive optimization method of network weights called AMSGrad. The proposed framework is verified by the realistic driving cycle, then is compared to the dynamic programming (DP) method and the previous deep reinforcement learning method. Simulation results show that the newly constructed deep reinforcement learning framework achieves higher training efficiency and lower energy consumption than the previous deep reinforcement learning method does, and the fuel economy is proved to approach the global optimality. Besides, its adaptability and robustness are validated by different driving schedules.
AB - A novel deep reinforcement learning (DRL) control framework for the energy management strategy of the series hybrid electric tracked vehicle (SHETV) is proposed in this paper. Firstly, the powertrain model of the vehicle is established, and the formulation of the energy management problem is given. Then, an efficient deep reinforcement learning framework based on the double deep Q-learning (DDQL) algorithm is built for the optimal problem solving, which also contains a modified prioritized experience replay (MPER) and an adaptive optimization method of network weights called AMSGrad. The proposed framework is verified by the realistic driving cycle, then is compared to the dynamic programming (DP) method and the previous deep reinforcement learning method. Simulation results show that the newly constructed deep reinforcement learning framework achieves higher training efficiency and lower energy consumption than the previous deep reinforcement learning method does, and the fuel economy is proved to approach the global optimality. Besides, its adaptability and robustness are validated by different driving schedules.
KW - Adaptive optimization method
KW - Double deep Q-learning algorithm
KW - Energy management control
KW - Modified prioritized experience replay
KW - Series hybrid electric vehicle
UR - http://www.scopus.com/inward/record.url?scp=85119429485&partnerID=8YFLogxK
U2 - 10.1016/j.energy.2021.122523
DO - 10.1016/j.energy.2021.122523
M3 - Article
AN - SCOPUS:85119429485
SN - 0360-5442
VL - 241
JO - Energy
JF - Energy
M1 - 122523
ER -