CGGI-CM: Combining Gesture and Gaze Interface for CAD Modeling Based on Context Model

Existing “gesture + gaze” multimodal interfaces for Computer-aided design (CAD) still suffer from fixed mapping relationships between interactive operations and CAD commands. In this paper, we proposed a multimodal interface CGGI-CM: Combining Gesture and Gaze Interface for CAD Modeling Based on Context Model. By introducing a context model that can describe human-computer interaction scenarios in CAD modeling, a flexible one-to-multi mapping of interactive operations to CAD commands was achieved and the number of CAD commands mapped by gesture increased by 100%. To verify the performance of CGGI-CM, a user experiment was conducted and the results were compared with those of a conventional “mouse + keyboard” interface (MKI). The experiment results showed that CGGI-CM posted superior performance in task completion time compared with MKI. For task operation accuracy, there is little difference between CGGI-CM and MKI. Moreover, users found that CGGI-CM is more intuitive and natural than MKI in CAD modeling.