TY - JOUR
T1 - Deep discriminative causal domain generalization
AU - Li, Shanshan
AU - Zhao, Qingjie
AU - Zhang, Changchun
AU - Zou, Yuanbing
N1 - Publisher Copyright:
© 2023
PY - 2023/10
Y1 - 2023/10
N2 - Domain generalization aims to generalize knowledge learned from multi-domains sources to a target domain whose statistical distribution is unknown. The mainstream approach to domain generalization involves learning domain-invariant features by aligning them across the domain distribution. However, these methods usually neglect the causal relationship between the instances and class labels; thus, the domain generalization model may learn the features that are not causally related to the label predictions and lead to potential misclassification. To address this problem, we propose a deep discriminative causal domain generalization (DDCDG), which can effectively learn causal feature representations. Specifically, we first imitate various possible intervention styles by applying an enriched data augmentation technique while preserving causal features relevant to the prediction task. We then designed a new regularization term for causal feature disentanglement, aiming to separate the causal and non-causal features. Additionally, we introduce centre alignment to approximate the representations of cross-domain homogeneous objects and enhance their discriminative ability. Extensive cross-domain visual recognition experiments were conducted, and the results show that our method can achieve a significant improvement in classification accuracy when compared with existing state-of-the-art methods on the Domainbed benchmark.
AB - Domain generalization aims to generalize knowledge learned from multi-domains sources to a target domain whose statistical distribution is unknown. The mainstream approach to domain generalization involves learning domain-invariant features by aligning them across the domain distribution. However, these methods usually neglect the causal relationship between the instances and class labels; thus, the domain generalization model may learn the features that are not causally related to the label predictions and lead to potential misclassification. To address this problem, we propose a deep discriminative causal domain generalization (DDCDG), which can effectively learn causal feature representations. Specifically, we first imitate various possible intervention styles by applying an enriched data augmentation technique while preserving causal features relevant to the prediction task. We then designed a new regularization term for causal feature disentanglement, aiming to separate the causal and non-causal features. Additionally, we introduce centre alignment to approximate the representations of cross-domain homogeneous objects and enhance their discriminative ability. Extensive cross-domain visual recognition experiments were conducted, and the results show that our method can achieve a significant improvement in classification accuracy when compared with existing state-of-the-art methods on the Domainbed benchmark.
KW - Causal feature disentanglement
KW - Centre alignment
KW - Domain generalization
KW - Representation learning
UR - http://www.scopus.com/inward/record.url?scp=85163196729&partnerID=8YFLogxK
U2 - 10.1016/j.ins.2023.119335
DO - 10.1016/j.ins.2023.119335
M3 - Article
AN - SCOPUS:85163196729
SN - 0020-0255
VL - 645
JO - Information Sciences
JF - Information Sciences
M1 - 119335
ER -