跳到主要导航 跳到搜索 跳到主要内容

FedEmo: A Federated Learning Framework for Privacy-Preserving Emotion Detection From Handwriting on Consumer IoMT Devices

  • Zohaib Ahmad Khan
  • , Yuanqing Xia*
  • , Weiwei Jiang
  • , Muhammad Shahid Anwar
  • *此作品的通讯作者
  • Beijing Institute of Technology
  • Zhongyuan University of Technology
  • Beijing University of Posts and Telecommunications
  • King Fahd University of Petroleum and Minerals

科研成果: 期刊稿件 › 文章 › 同行评审

摘要

Emotion detection from handwriting and drawing presents a promising yet underexplored avenue for scalable mental health monitoring. This is particularly relevant within consumer-centric Internet of Medical Things (IoMT) ecosystems, where privacy and cross-institutional data sharing remain critical challenges. This paper proposes FedEmo, a privacy-preserving federated learning framework that leverages an attention-based transformer model to analyze handwriting and drawing samples on edge devices, while adhering to Health Insurance Portability and Accountability Act (HIPAA) and General Data Protection Regulation (GDPR) regulations. The model processes stroke-level features (e.g., pen pressure, speed, and direction during handwriting or drawing tasks), which are key indicators of emotional states, through self-attention mechanisms, achieving 92.64% accuracy on the EMOTHAW dataset under centralized training. A federated protocol enables distributed model refinement without sharing raw data, maintaining 87.3% accuracy in simulated non-Independent and Identically Distributed (non-IID) settings, consistent with existing federated learning benchmarks. The framework introduces a hybrid cloud-edge deployment that reduces communication bandwidth by 58% through local embedding computation, and supports a clinician alert system with a modeled end-to-end latency of 620ms. Experimental results confirm the system’s robustness under typical IoMT constraints, including 15% packet loss and 100kbps bandwidth. FedEmo offers a scalable, privacy-compliant solution for real-time emotion recognition and remote mental health diagnostics using consumer-grade IoMT devices, with potential applications in telepsychiatry and early screening for depression and Parkinson’s disease.

源语言英语
页(从-至)11315-11326
页数12
期刊IEEE Transactions on Consumer Electronics
卷71
期4
DOI
出版状态已出版 - 2025
已对外发布是

学术指纹

探究 'FedEmo: A Federated Learning Framework for Privacy-Preserving Emotion Detection From Handwriting on Consumer IoMT Devices' 的科研主题。它们共同构成独一无二的学术指纹。

引用此