装甲车辆多模态交互和环境负荷对乘员任务绩效的影响

With the progress of information technology,the human-computer interaction modes of armored vehicles have been constantly updated. In order to explore the mission performance of occupant in new multimodal interaction and guide the design of multimodal operation and warning modes of future armored vehicles,a human-computer interaction experimental system which integrates multimodal interaction and adjusts the environmental load is established. Based on this system, 20 adult males were recruited to conduct an ergonomics experiment involving operation (input) mode, warning (output) mode and environmental load level. The simulated target hitting experiments under different experimental conditions are performed in a virtual experimental platform,and the mission performances of occupants are analyzed. The experimental results show that the reaction time of occupant under mechanical input is the shortest and the operation error rate is the highest compared with those under touch input or voice input. The mission completion time of occupant under mechanical input and touch input is much shorter than that under voice input. Compared to the single modal visual (V) warning,the visual+tactile (V+T) dual-modal warning superimposed with tactile warning is used to significantly shorten the reaction time of occupant,while the visual+auditory (V+A) dual-modal warning superimposed with auditory warning has no significant difference. V + T or V + A dual-modal warning can significantly shorten the mission completion time of occupant. For the influence of environmental load,the mission performance of crew under low environmental load is significantly higher than that under high environmental load. As the environmental load increases,superimposing A warning in V+T warning will cause warning redundancy. The research can provide a practical basis for the design of multi-modal human-computer interaction in the armored vehicle cabin.