A joint learning method for incomplete and imbalanced data in electronic health record based on generative adversarial networks

Xutao Weng, Hong Song*, Yucong Lin, You Wu, Xi Zhang, Bowen Liu, Jian Yang*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)

Abstract

Electronic health records (EHR), present challenges of incomplete and imbalanced data in clinical predictions. Previous studies addressed these two issues with two-step separately, which caused the decrease in the performance of prediction tasks. In this paper, we propose a unified framework to simultaneously addresses the challenges of incomplete and imbalanced data in EHR. Based on the framework, we develop a model called Missing Value Imputation and Imbalanced Learning Generative Adversarial Network (MVIIL-GAN). We use MVIIL-GAN to perform joint learning on the imputation process of high missing rate data and the conditional generation process of EHR data. The joint learning is achieved by introducing two discriminators to distinguish the fake data from the generated data at sample-level and variable-level. MVIIL-GAN integrate the missing values imputation and data generation in one step, improving the consistency of parameter optimization and the performance of prediction tasks. We evaluate our framework using the public dataset MIMIC-IV with high missing rates data and imbalanced data. Experimental results show that MVIIL-GAN outperforms existing methods in prediction performance. The implementation of MVIIL-GAN can be found at https://github.com/Peroxidess/MVIIL-GAN.

Original languageEnglish
Article number107687
JournalComputers in Biology and Medicine
Volume168
DOIs
Publication statusPublished - Jan 2024

Keywords

  • Electronic health records
  • Generative adversarial networks
  • Imbalanced learning
  • Missing values imputation

Fingerprint

Dive into the research topics of 'A joint learning method for incomplete and imbalanced data in electronic health record based on generative adversarial networks'. Together they form a unique fingerprint.

Cite this