Skip to main navigation Skip to search Skip to main content

MBGN: multimodal BiFPN gate network for in-process GMAW defect detection

  • Xuefeng Zhao
  • , Yang She
  • , Giulio Mattera
  • , Lichao Hu
  • , Zhen Sun
  • , Yan Li
  • , Xinghua Yu*
  • *Corresponding author for this work
  • Beijing Institute of Technology
  • University of Naples Federico II
  • Ltd.
  • Shandong University

Research output: Contribution to journalArticlepeer-review

Abstract

In-process defect monitoring is critical for guaranteeing the integrity of Gas Metal Arc Welding (GMAW) joints. Conventional non-destructive testing (NDT) delivers high-quality diagnostics only after the weld has finished, precluding immediate corrective action. We present the Multi-modal BiFPN Gate Network (MBGN), a deep-learning framework that fuses two complementary data streams: (i) time-synchronized welding current and voltage waveforms processed by a one-dimensional CNN, and (ii) high-speed molten-pool imagery processed by a ResNet backbone. The two modalities are merged through a Bidirectional Feature Pyramid Network (BiFPN), and a lightweight Gate module adaptively recalibrates cross-modal interactions before a final classifier. Experiments on an industrially collected multimodal dataset demonstrate that MBGN achieved 0.748 accuracy and 0.719 macro-F1 on the held-out evaluation set. Compared with the strongest task-matched multimodal baseline, MWFN, MBGN improved macro-F1 by 0.120 while maintaining comparable accuracy. These results indicate the potential of multimodal fusion for in-process GMAW defect monitoring under the investigated industrial conditions, while broader deployment still requires validation across additional materials, joint types, and online system configurations.

Original languageEnglish
Article number114696
JournalMechanical Systems and Signal Processing
Volume258
DOIs
Publication statusPublished - 15 Aug 2026

Keywords

  • Deep learning
  • Defect detection
  • In-process monitoring
  • Multimodal
  • Weld

Fingerprint

Dive into the research topics of 'MBGN: multimodal BiFPN gate network for in-process GMAW defect detection'. Together they form a unique fingerprint.

Cite this