Scalable Accelerated Intelligent Charging Strategy Recommendation for Electric Vehicles Based on Deep Q-Networks

Xianhao Shen, Zhen Wu, Yexin Zhang, Shaohua Niu*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

With the rapid development of electric vehicles, their charging strategies significantly impact the overall power grid. Solving the spatiotemporal scheduling problem of vehicle charging has become a hot research topic. This paper focuses on recommending suitable charging stations for electric vehicles and proposes a scalable accelerated intelligent charging strategy recommendation algorithm based on Deep Q-Networks (DQN). The strategy recommendation problem is formulated as a Markov decision process, where the continuous sequence of regional charging requests within a time slice is fed into the DQN network as the input state, enabling optimal charging strategy recommendations for each electric vehicle. The algorithm aims to maintain regional load balance while minimizing user waiting time. To enhance the algorithm's applicability, a scalable, accelerated charging strategy framework is further proposed, which incorporates information filtering and shared experience pool mechanisms to adapt to different expansion scenarios and expedite strategy iterations in new scenarios. Simulation results demonstrate that the proposed DQN-based strategy recommendation algorithm outperforms the shortest path-first strategy, and the scalable, accelerated charging strategy framework achieves a 64.3% improvement in iteration speed in new scenarios, which helps to reduce the cloud server load and saves overheads.

Original languageEnglish
Pages (from-to)755-763
Number of pages9
JournalInternational Journal of Advanced Computer Science and Applications
Volume15
Issue number1
DOIs
Publication statusPublished - 2024

Keywords

  • Deep Q-network
  • Markov decision
  • Scalable acceleration
  • smart charging

Fingerprint

Dive into the research topics of 'Scalable Accelerated Intelligent Charging Strategy Recommendation for Electric Vehicles Based on Deep Q-Networks'. Together they form a unique fingerprint.

Cite this