Skip to main navigation Skip to search Skip to main content

GMMDA: Gaussian Mixture Model-Based Generative Domain Adaptive Semantic Segmentation for Remote Sensing Images

  • Beijing Institute of Technology
  • National Key Laboratory of Science and Technology on Space-Born Intelligent Information Processing
  • Beijing Institute of Remote Sensing Information

Research output: Contribution to journalArticlepeer-review

Abstract

Unsupervised domain adaptation (UDA) for semantic segmentation transfers knowledge from an annotated source domain to an unlabeled target domain, reducing the cost of pixel-level annotation. Most existing methods rely on dense discriminative classifiers that estimate pixel-wise class posterior probabilities using a single weight vector per class. However, in remote sensing imagery, intraclass variability often gives rise to multipeaked feature distributions with multiple subclusters, which may not be adequately captured by a single weight vector, leading to intraclass confusion. Moreover, such discriminative classifiers primarily focus on learning class decision boundaries, while the consistency of same-class subclusters across domains is only weakly constrained. Under domain shift, these subclusters may drift inconsistently, thereby aggravating cross-domain structural mismatch. To this end, we propose GMMDA, a Gaussian mixture model (GMM)-based generative domain adaptation method that predicts pixel labels through Bayesian inference based on class-conditional feature likelihoods. Specifically, we fit a class-wise GMM using an online momentum Sinkhorn EM procedure to model class-conditional feature densities, where each Gaussian component corresponds to an intraclass subcluster, enabling a richer characterization of multipeaked distributions. Furthermore, component-aware contrastive learning (CCL) treats Gaussian components as fine-grained semantic References, pulling target-domain features toward their best-matched components using a variance-aware distance that accounts for component scales. In addition, we introduce componentwise distribution alignment (CDA) to align each source component with the corresponding source-guided target local statistics by jointly constraining their means and principal directions, aiming to reduce cross-domain structural mismatch. Experimental results show that GMMDA achieves competitive mean intersection over union (mIoU) scores on the international society for photogrammetry and remote sensing (ISPRS) and LoveDA benchmarks compared with existing methods.

Original languageEnglish
Article number5633118
JournalIEEE Transactions on Geoscience and Remote Sensing
Volume64
DOIs
Publication statusPublished - 2026
Externally publishedYes

Keywords

  • Contrastive learning
  • distribution alignment
  • generative model
  • unsupervised domain adaptation (UDA) for semantic segmentation

Fingerprint

Dive into the research topics of 'GMMDA: Gaussian Mixture Model-Based Generative Domain Adaptive Semantic Segmentation for Remote Sensing Images'. Together they form a unique fingerprint.

Cite this