TY - JOUR
T1 - NoFatigueDriving
T2 - Adaptive Cross-Modal Fusion for IoT-Enabled Wearable Driver Fatigue Detection
AU - Liu, Mengzhen
AU - Liu, Siyu
AU - Ming, Zhiyuan
AU - Luo, Jiawei
AU - Fang, Xu
AU - Ma, Lingfei
AU - Huang, Yilun
AU - Liu, Chao
AU - Jiang, Dongxiang
AU - Yan, Tianyi
N1 - Publisher Copyright:
© 2014 IEEE.
PY - 2026
Y1 - 2026
N2 - Driver fatigue is a major cause of traffic accidents, yet single-modality wearable approaches struggle to capture its multidimensional nature under resource constraints. This paper presents an end-to-end Internet of Things (IoT)-enabled driver fatigue detection system that decouples data acquisition on a lightweight headband from cloud-hosted inference. At its core is the Trimodal Fatigue Detection Network (TFD-Net), which utilizes signal-specific encoders, bidirectional pairwise cross-modal attention, and a two-level adaptive gated fusion module. On a 12-participant dataset, TFD-Net achieves a state-of-the-art accuracy of 94.40 ± 2.93%, outperforming the best baseline by 2.16%. Ablation and t-SNE analyses confirm that our trimodal fusion improves accuracy by 5.44% over Electroencephalography (EEG)-only models while providing high biophysical interpretability. This system demonstrates the potential of cloud-assisted multimodal wearable sensing for robust, real-time driving safety applications. The code is available at GitHub.
AB - Driver fatigue is a major cause of traffic accidents, yet single-modality wearable approaches struggle to capture its multidimensional nature under resource constraints. This paper presents an end-to-end Internet of Things (IoT)-enabled driver fatigue detection system that decouples data acquisition on a lightweight headband from cloud-hosted inference. At its core is the Trimodal Fatigue Detection Network (TFD-Net), which utilizes signal-specific encoders, bidirectional pairwise cross-modal attention, and a two-level adaptive gated fusion module. On a 12-participant dataset, TFD-Net achieves a state-of-the-art accuracy of 94.40 ± 2.93%, outperforming the best baseline by 2.16%. Ablation and t-SNE analyses confirm that our trimodal fusion improves accuracy by 5.44% over Electroencephalography (EEG)-only models while providing high biophysical interpretability. This system demonstrates the potential of cloud-assisted multimodal wearable sensing for robust, real-time driving safety applications. The code is available at GitHub.
KW - cross-modal attention
KW - driver fatigue detection
KW - Internet of Things (IoT)
KW - multimodal fusion
KW - wearable sensors
UR - https://www.scopus.com/pages/publications/105046273099
U2 - 10.1109/JIOT.2026.3718429
DO - 10.1109/JIOT.2026.3718429
M3 - Article
AN - SCOPUS:105046273099
SN - 2327-4662
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
ER -