TY - JOUR
T1 - MCM-DeepFuzz
T2 - fuzzing for DNNs with multiple criteria and mutation
AU - He, Jinyuan
AU - Zhao, Pengfei
AU - Ma, Rui
AU - Liu, Jingyuan
N1 - Publisher Copyright:
© The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2026.
PY - 2026/6
Y1 - 2026/6
N2 - Deep neural network(DNN) is the core of artificial intelligence applications. Recent progress in large-scale foundation models (FMs) further amplifies the importance of systematic reliability testing, as these complex models may fail unexpectedly under subtle input variations. Such challenges highlight the continued need for principled fuzzing techniques capable of discovering diverse execution behaviors and potential security problems in DNNs. However, despite recent progress in DNNs fuzzing, existing approaches remain limited in their execution-status analysis and mutation strategies, motivating our design of a more comprehensive and configurable framework. In this paper, we propose MCM-DeepFuzz, a fuzzing framework for deep neural networks with configurable execution status analysis and mutation strategies to improve the effectiveness of fuzzing. It combines 6 coverage criteria to analyze execution status and introduces 7 image operations as mutation strategies. Furthermore, we introduce the concept of sensitivity to evaluate these criteria with the MNIST dataset on CNN and MLP models, showing the characteristics and differences of existing coverage criteria. We also analyze how parameters and hidden layers affect the sensitivity of coverage criteria. Extensive experiment also demonstrates the feasibility and effectiveness of these mutation strategies.
AB - Deep neural network(DNN) is the core of artificial intelligence applications. Recent progress in large-scale foundation models (FMs) further amplifies the importance of systematic reliability testing, as these complex models may fail unexpectedly under subtle input variations. Such challenges highlight the continued need for principled fuzzing techniques capable of discovering diverse execution behaviors and potential security problems in DNNs. However, despite recent progress in DNNs fuzzing, existing approaches remain limited in their execution-status analysis and mutation strategies, motivating our design of a more comprehensive and configurable framework. In this paper, we propose MCM-DeepFuzz, a fuzzing framework for deep neural networks with configurable execution status analysis and mutation strategies to improve the effectiveness of fuzzing. It combines 6 coverage criteria to analyze execution status and introduces 7 image operations as mutation strategies. Furthermore, we introduce the concept of sensitivity to evaluate these criteria with the MNIST dataset on CNN and MLP models, showing the characteristics and differences of existing coverage criteria. We also analyze how parameters and hidden layers affect the sensitivity of coverage criteria. Extensive experiment also demonstrates the feasibility and effectiveness of these mutation strategies.
KW - Coverage criteria
KW - Coverage-guided testing
KW - Deep neural networks
KW - Fuzzing
KW - Mutation strategies
UR - https://www.scopus.com/pages/publications/105037903910
U2 - 10.1007/s10044-026-01678-z
DO - 10.1007/s10044-026-01678-z
M3 - Article
AN - SCOPUS:105037903910
SN - 1433-7541
VL - 29
JO - Pattern Analysis and Applications
JF - Pattern Analysis and Applications
IS - 2
M1 - 90
ER -