Active learning sample selection based on multicriteria

Zhonghai He, Kun Shen*, Xiaofang Zhang

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

In multivariate calibration problems, model performance is affected significantly by the calibration samples used during model building. In recent years, active learning methods have become one of the best methods for sample selection. However, most active learning methods only select instances from prediction uncertainty or sample space distance, and these single-criteria methods tend to select undesired samples. In addition, sample density characterizes the spatial information carried by the sample, but few studies in quantitative analysis utilize sample density alone to select calibration samples. Considering these issues, based on the k-means clustering algorithm, this paper proposes an active learning sample selection method (Diversity Informativeness Density Active Learning, DIDAL), which combines the three criteria of diversity, informativeness and sample density. The most representative sample is iteratively selected for - addition to the calibration set for modeling and estimating the chemical concentration of analytes. Soybean meal and soy sauce samples were analyzed by DIDAL and compared with existing sample selection methods. The prediction results show that the DIDAL algorithm significantly outperforms several existing algorithms and is close to the performance of full-sample modeling. A model with high prediction accuracy can be constructed by selecting only a few samples using the DIDAL method.

Original languageEnglish
Pages (from-to)289-297
Number of pages9
JournalJournal of Near Infrared Spectroscopy
Volume31
Issue number6
DOIs
Publication statusPublished - Dec 2023

Keywords

  • Multivariate calibration
  • active learning
  • multicriteria modeling
  • sample selection

Fingerprint

Dive into the research topics of 'Active learning sample selection based on multicriteria'. Together they form a unique fingerprint.

Cite this