TY - JOUR
T1 - BC-PINN
T2 - an adaptive physics informed neural network based on biased multiobjective coevolutionary algorithm
AU - Zhu, Zhicheng
AU - Hao, Jia
AU - Huang, Jin
AU - Huang, Biao
N1 - Publisher Copyright:
© 2023, The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature.
PY - 2023/10
Y1 - 2023/10
N2 - Physics informed neural network (PINN) has become a promising method for solving partial differential equations (PDEs). The loss function of PINN is a weighted sum of multiple items. This makes it easy to fall into local optima, especially the gradient pathologies when solving high frequency problems. The value of penalty coefficients has a crucial impact on the prediction results. Therefore, a new PINN with adaptive penalty coefficients iteratively optimized by biased multiobjective coevolutionary algorithm (BC-PINN) is presented. In BC-PINN, a two-stage optimization mechanism is used to search for parameters of neural network and penalty coefficients respectively. This method involves constructing the fitness function of penalty coefficients based on the biased dominance ranking by data item and regularization item. Compared with the previous works of others, the accuracy of fitting the initial conditions and boundary conditions is considered to be given priority, which is more conducive to PINN converging to the particular solution of PDE. In addition, the set of penalty coefficients is divided into multiple populations to improve the optimization efficiency through coevolutionary algorithm. The empirical results show that: (1) Our method can improve the gradient pathologies and effectively capture the high-frequency features. (2) Compared to the original PINN, it reduces the MSE by 1–6 orders of magnitude in our benchmark functions.
AB - Physics informed neural network (PINN) has become a promising method for solving partial differential equations (PDEs). The loss function of PINN is a weighted sum of multiple items. This makes it easy to fall into local optima, especially the gradient pathologies when solving high frequency problems. The value of penalty coefficients has a crucial impact on the prediction results. Therefore, a new PINN with adaptive penalty coefficients iteratively optimized by biased multiobjective coevolutionary algorithm (BC-PINN) is presented. In BC-PINN, a two-stage optimization mechanism is used to search for parameters of neural network and penalty coefficients respectively. This method involves constructing the fitness function of penalty coefficients based on the biased dominance ranking by data item and regularization item. Compared with the previous works of others, the accuracy of fitting the initial conditions and boundary conditions is considered to be given priority, which is more conducive to PINN converging to the particular solution of PDE. In addition, the set of penalty coefficients is divided into multiple populations to improve the optimization efficiency through coevolutionary algorithm. The empirical results show that: (1) Our method can improve the gradient pathologies and effectively capture the high-frequency features. (2) Compared to the original PINN, it reduces the MSE by 1–6 orders of magnitude in our benchmark functions.
KW - Biased multiobjective optimization
KW - Coevolutionary algorithm
KW - Gradient pathologies
KW - Physics informed neural network
UR - http://www.scopus.com/inward/record.url?scp=85166315104&partnerID=8YFLogxK
U2 - 10.1007/s00521-023-08876-4
DO - 10.1007/s00521-023-08876-4
M3 - Article
AN - SCOPUS:85166315104
SN - 0941-0643
VL - 35
SP - 21093
EP - 21113
JO - Neural Computing and Applications
JF - Neural Computing and Applications
IS - 28
ER -