Cluster optimized batch mode active learning sample selection method

  • Zhonghai He*
  • , Zhichao Xia
  • , Yinzhi Du
  • , Xiaofang Zhang
  • *Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

Active learning for selecting representative samples submitted to labeling can save model development costs. However, the performance of single-sample selection in each iteration is compromised by a heavy computational burden and low efficiency in reference measurements, issues that can be addressed through batch mode active learning. The sample redundancy in batch mode active learning has long been a challenge. To overcome the shortcomings, a batch mode sample selection method that takes representativeness, diversity, and informativeness into account is proposed, called Gaussian Process Cluster Optimized Active Learning (GPCOAL). Firstly, the Gaussian process is utilized to obtain the variance (information) of each sample. Subsequently, K-means clustering is performed to ensure diversity, and the sample with largest silhouettes is selected from each cluster to ensure representativeness. Finally, the Gaussian process variance and the silhouettes of each sample are integrated to select the most suitable samples within each cluster. Experimental validation is conducted on spectroscopic datasets to illustrate the effectiveness of the GPCOAL sample selection method.

Original languageEnglish
Article number105746
JournalInfrared Physics and Technology
Volume145
DOIs
Publication statusPublished - Mar 2025
Externally publishedYes

Keywords

  • Batch mode active learning
  • Gaussian process
  • K-means clustering
  • Silhouettes

Cite this