Contraction mapping of feature norms for data quality imbalance learning

Weihua Liu, Xiabi Liu*, Huiyu Li, Chaochao Lin

*此作品的通讯作者

科研成果: 期刊稿件文章同行评审

摘要

The popular softmax loss and its recent extensions have achieved great success in deep learning-based image classification. However, the data for training image classifiers often exhibit a highly skewed distribution in quality, i.e., the number of data with good quality is much more than that with low quality. If this problem is ignored, low-quality data are hard to classify correctly. In this paper, we discover the positive correlation between the quality of an image and its feature norm (L2-norm) learned from softmax loss through careful experiments on various applications with different deep neural networks. Based on this finding, we propose a contraction mapping function to compress the range of feature norms of training images according to their quality and embed this contraction mapping function into softmax loss and its extensions to produce novel learning objectives. Experiments on various applications, including handwritten digit recognition, lung nodule classification, and face recognition, demonstrate that the proposed approach is promising to effectively deal with the problem of learning quality imbalance data and leads to significant and stable improvements in the classification accuracy. The code is available at https://github.com/Huiyu-Li/CM-M-Softmax-Loss.

源语言英语
页(从-至)232-238
页数7
期刊Pattern Recognition Letters
185
DOI
出版状态已出版 - 9月 2024

指纹

探究 'Contraction mapping of feature norms for data quality imbalance learning' 的科研主题。它们共同构成独一无二的指纹。

引用此