Exploring the Effects of Embodied Interaction on Creative Thinking Based on Neurophysiological Measures

Embodied interaction based on multimodal technology allows designers to create in an "all-in-one" manner, and the impact of this interaction on creative thinking in the design process needs to be explored in depth. The neurophysiological measures of designers in traditional "keyboard + mouse" interaction and embodied interaction are compared to investigate the influence of embodied interaction on designers' creative thinking. Thirty-four designers complete a three-dimensional composition design task in a computer-aided design system using the traditional and embodied interaction respectively. Cognitive data such as electroencephalograms, heart rates, workload scales and verbal reports are collected simultaneously under both interaction modes. In addition, the design solutions are assessed for creativity using the Consensus Assessment Technique. The results of the data analysis show that, (i) the alpha band power of the designer's parietal and occipital regions under embodied interaction is significantly lower than that of traditional interaction, indicating that the connection between the body and the virtual design space enhances the designer's visual processing and facilitates the generation of creative thinking; and (ii) the suppression of alpha and beta bands of the designer's sensorimotor region under embodied interaction suggests that the consistency of the designer's body movements, postures, and daily experience accelerates designers' understanding of movement metaphors, which has a stimulating effect on creative thinking; (iii) the significant increase in the designer's electrodermal activity and heart rate values under embodied interaction suggests that the novelty and flexibility of the operation process can bring about emotional arousal for designers, which is conducive to the generation of creative thinking; (iv) designers need more training and have a heavier workload in embodied interaction, which may have a negative impact on creative thinking. This suggests that the maturity of multimodal technology needs to be further improved in the future.