跳到主要导航 跳到搜索 跳到主要内容

MBGN: multimodal BiFPN gate network for in-process GMAW defect detection

  • Xuefeng Zhao
  • , Yang She
  • , Giulio Mattera
  • , Lichao Hu
  • , Zhen Sun
  • , Yan Li
  • , Xinghua Yu*
  • *此作品的通讯作者
  • Beijing Institute of Technology
  • University of Naples Federico II
  • Ltd.
  • Shandong University

科研成果: 期刊稿件文章同行评审

摘要

In-process defect monitoring is critical for guaranteeing the integrity of Gas Metal Arc Welding (GMAW) joints. Conventional non-destructive testing (NDT) delivers high-quality diagnostics only after the weld has finished, precluding immediate corrective action. We present the Multi-modal BiFPN Gate Network (MBGN), a deep-learning framework that fuses two complementary data streams: (i) time-synchronized welding current and voltage waveforms processed by a one-dimensional CNN, and (ii) high-speed molten-pool imagery processed by a ResNet backbone. The two modalities are merged through a Bidirectional Feature Pyramid Network (BiFPN), and a lightweight Gate module adaptively recalibrates cross-modal interactions before a final classifier. Experiments on an industrially collected multimodal dataset demonstrate that MBGN achieved 0.748 accuracy and 0.719 macro-F1 on the held-out evaluation set. Compared with the strongest task-matched multimodal baseline, MWFN, MBGN improved macro-F1 by 0.120 while maintaining comparable accuracy. These results indicate the potential of multimodal fusion for in-process GMAW defect monitoring under the investigated industrial conditions, while broader deployment still requires validation across additional materials, joint types, and online system configurations.

源语言英语
文章编号114696
期刊Mechanical Systems and Signal Processing
258
DOI
出版状态已出版 - 15 8月 2026

学术指纹

探究 'MBGN: multimodal BiFPN gate network for in-process GMAW defect detection' 的科研主题。它们共同构成独一无二的学术指纹。

引用此