An Efficient Reconfigurable Battery Network based on the Asynchronous Advantage Actor-Critic Paradigm

Although the battery systems continue to grow in electric vehicles, smart grids, and backup power systems due to their capability to supply power and energy, the current battery systems essentially are fixed which limits efficient energy usage. Recently, by employing the digital battery concept through energy digitization, traditional battery systems can be transformed into re-configurable battery networks (RBN). This RBN paradigm improves the inherent defects of the fixed battery system, which means the performance of the RBN will no longer be limited by the consistency of the cells. In this paper, an adaptive control framework with the asynchronous advantage actor-critic (A3C) paradigm on performing online optimization for the dynamical RBN system is proposed. By utilizing its policy and asynchronous learning property, the proposed paradigm is able to improve the learning performance and the battery pack capacity through an improvement of cell consistency. It is noted that the proposed method is verified by both the simulation and experiment with data from an RBN.