TY - JOUR
T1 - System-of-systems effectiveness evaluation of UAV swarm
T2 - A data-driven perspective
AU - QUAN, Wei
AU - CHEN, Chen
AU - DENG, Fang
AU - XIN, Bin
N1 - Publisher Copyright:
© 2025 The Author(s)
PY - 2026/8
Y1 - 2026/8
N2 - System-of-Systems Effectiveness Evaluation (SEE) is crucial for systematically assessing Unmanned Aerial Vehicle Swarms (UAVS). However, due to the strong nonlinear, hierarchical, and emergent characteristics of UAVS, traditional SEE methods based on experience and mathematical analysis are challenging to apply to such complex systems. In this article, we propose a Data-driven SEE framework that leverages deep learning to establish the relationship between system-of-systems indicators and effectiveness, effectively capturing the complex characteristics of UAVS. The system-of-systems indicators are first transformed by two-dimensional loop stacking and then processed by a residual neural network-based evaluation network. Furthermore, to address the practical need to mitigate overestimation in effectiveness evaluation, a skewed loss function is designed to adjust overestimation during the training process. Since training a Data-driven model requires a large number of labeled samples, which are obtained through time-consuming simulation-based annotation, we develop an active learning strategy based on cluster iteration and random greedy sampling. This strategy selects a limited number of high-value samples for simulation labeling while maintaining model accuracy. The experimental results demonstrate that this model can quickly, accurately, and efficiently evaluate the effectiveness of unmanned swarm systems. Additionally, the data-driven SEE framework shows strong potential for UAVS system analysis and optimization.
AB - System-of-Systems Effectiveness Evaluation (SEE) is crucial for systematically assessing Unmanned Aerial Vehicle Swarms (UAVS). However, due to the strong nonlinear, hierarchical, and emergent characteristics of UAVS, traditional SEE methods based on experience and mathematical analysis are challenging to apply to such complex systems. In this article, we propose a Data-driven SEE framework that leverages deep learning to establish the relationship between system-of-systems indicators and effectiveness, effectively capturing the complex characteristics of UAVS. The system-of-systems indicators are first transformed by two-dimensional loop stacking and then processed by a residual neural network-based evaluation network. Furthermore, to address the practical need to mitigate overestimation in effectiveness evaluation, a skewed loss function is designed to adjust overestimation during the training process. Since training a Data-driven model requires a large number of labeled samples, which are obtained through time-consuming simulation-based annotation, we develop an active learning strategy based on cluster iteration and random greedy sampling. This strategy selects a limited number of high-value samples for simulation labeling while maintaining model accuracy. The experimental results demonstrate that this model can quickly, accurately, and efficiently evaluate the effectiveness of unmanned swarm systems. Additionally, the data-driven SEE framework shows strong potential for UAVS system analysis and optimization.
KW - Active learning
KW - Data-driven
KW - Deep learning
KW - Effectiveness evaluation
KW - System-of-systems
KW - Unmanned aerial vehicle
UR - https://www.scopus.com/pages/publications/105043960266
U2 - 10.1016/j.cja.2025.103848
DO - 10.1016/j.cja.2025.103848
M3 - Article
AN - SCOPUS:105043960266
SN - 1000-9361
VL - 39
JO - Chinese Journal of Aeronautics
JF - Chinese Journal of Aeronautics
IS - 8
M1 - 103848
ER -