TY - JOUR
T1 - Embodied Neuromorphic Intelligence in Healthcare
T2 - Evaluating Pose-Matching Interaction Using fNIRS and Behavioral Data
AU - Qu, Jing
AU - Wang, Wenxiu
AU - Ren, Xipei
AU - Zhang, Yuzi
AU - Bu, Lingguo
AU - Liu, Lei
N1 - Publisher Copyright:
© 2024 IEEE.
PY - 2024
Y1 - 2024
N2 - In the era of Industry 5.0, the rapid development of the Internet of Things (IoT) is expected to extend its applications to broader human-computer interaction (HCI) and human-machine connectivity. With the increasing number of healthcare groups, there is an urgent need to develop embodied neuromorphic intelligent human-machine connectivity products based on these technologies. However, it remains a critical challenge to address the influencing factors of such product designs and how to quantify interaction efficacy. This study proposes a product framework combining IoT with embodied neuromorphic intelligence and conducts a user study. A cognitive rehabilitation product was developed using Leap Motion technology, with gesture recognition difficulty as a design variable, and product efficacy was quantified using a combination of brain-computer interaction and multi-source interactive feedback. Fifteen elderly and fifteen young participants engaged in puppet control tasks under resting, simple, and complex conditions. The study compared brain activation levels, brain network connectivity, and eight behavioral indicators. The results demonstrated that the difficulty level significantly affects interaction efficacy. This research reveals neurological changes in the rehabilitation process of healthcare groups and opens new directions for the design and efficacy evaluation of embodied neuromorphic intelligence in HCI rehabilitation products through IoT and big data analytics, thereby advancing the development of Healthcare Industry 5.0.
AB - In the era of Industry 5.0, the rapid development of the Internet of Things (IoT) is expected to extend its applications to broader human-computer interaction (HCI) and human-machine connectivity. With the increasing number of healthcare groups, there is an urgent need to develop embodied neuromorphic intelligent human-machine connectivity products based on these technologies. However, it remains a critical challenge to address the influencing factors of such product designs and how to quantify interaction efficacy. This study proposes a product framework combining IoT with embodied neuromorphic intelligence and conducts a user study. A cognitive rehabilitation product was developed using Leap Motion technology, with gesture recognition difficulty as a design variable, and product efficacy was quantified using a combination of brain-computer interaction and multi-source interactive feedback. Fifteen elderly and fifteen young participants engaged in puppet control tasks under resting, simple, and complex conditions. The study compared brain activation levels, brain network connectivity, and eight behavioral indicators. The results demonstrated that the difficulty level significantly affects interaction efficacy. This research reveals neurological changes in the rehabilitation process of healthcare groups and opens new directions for the design and efficacy evaluation of embodied neuromorphic intelligence in HCI rehabilitation products through IoT and big data analytics, thereby advancing the development of Healthcare Industry 5.0.
KW - data-driven
KW - embodied neuromorphic intelligence
KW - human-computer interaction (HCI)
KW - neuroergonomics
KW - product design
UR - http://www.scopus.com/inward/record.url?scp=85212788250&partnerID=8YFLogxK
U2 - 10.1109/JIOT.2024.3512877
DO - 10.1109/JIOT.2024.3512877
M3 - Article
AN - SCOPUS:85212788250
SN - 2327-4662
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
ER -