TY - JOUR
T1 - DICNO
T2 - A Generalizable Digital Image Correlation Neural Operator
AU - Zhou, Yifan
AU - Zhang, Xuesong
AU - Zhao, Zhenfeng
N1 - Publisher Copyright:
© 1963-2012 IEEE.
PY - 2025
Y1 - 2025
N2 - Digital image correlation (DIC) is an optical metrology for dense displacement and strain fields measurement by tracking speckle patterns sprayed on the objects. As its name indicates, however, DIC relies on local image feature correlations and therefore faces challenges such as high time complexity and difficulties in computing large deformation fields. Although recent deep learning (DL)-based DIC methods have significantly accelerated the inference speed, enabling real-time measurements, these models often lack generalization to unseen deformation patterns and to varying resolutions due to their training on single deformation patterns. In addition, most DL approaches train two separate networks for the displacement and strain predictions, respectively, failing to leverage the inherent relationship between them. In this article, we introduce a novel neural operator method for DIC, digital image correlation neural operator (DICNO), that learns an operator directly mapping the latent features of two consecutive images to the underlying displacement and strain fields. By incorporating a multiresolution training strategy and continuous feature mapping, DICNO can efficiently handle various image resolutions and gain the scale generalization capability. Extensive experiments show that DICNO outperforms existing models across multiple datasets and complex scenarios, with substantial advantages in both precision and inference speed.
AB - Digital image correlation (DIC) is an optical metrology for dense displacement and strain fields measurement by tracking speckle patterns sprayed on the objects. As its name indicates, however, DIC relies on local image feature correlations and therefore faces challenges such as high time complexity and difficulties in computing large deformation fields. Although recent deep learning (DL)-based DIC methods have significantly accelerated the inference speed, enabling real-time measurements, these models often lack generalization to unseen deformation patterns and to varying resolutions due to their training on single deformation patterns. In addition, most DL approaches train two separate networks for the displacement and strain predictions, respectively, failing to leverage the inherent relationship between them. In this article, we introduce a novel neural operator method for DIC, digital image correlation neural operator (DICNO), that learns an operator directly mapping the latent features of two consecutive images to the underlying displacement and strain fields. By incorporating a multiresolution training strategy and continuous feature mapping, DICNO can efficiently handle various image resolutions and gain the scale generalization capability. Extensive experiments show that DICNO outperforms existing models across multiple datasets and complex scenarios, with substantial advantages in both precision and inference speed.
KW - Arbitrary scale
KW - Galerkin attention
KW - digital image correlation (DIC)
KW - neural operator (NO)
UR - https://www.scopus.com/pages/publications/105017144741
U2 - 10.1109/TIM.2025.3612640
DO - 10.1109/TIM.2025.3612640
M3 - Article
AN - SCOPUS:105017144741
SN - 0018-9456
VL - 74
JO - IEEE Transactions on Instrumentation and Measurement
JF - IEEE Transactions on Instrumentation and Measurement
M1 - 5046414
ER -