面向产品概念设计的多模态智能交互框架及实现

The traditional interaction mode of Computer Aided Design (CAD) based on "mouse+keyboard" is not conducive to the natural expression of design thinking. Facing the development demand of intelligent human-computer interaction technology in product conceptual design, an intelligent interaction mode was explored based on end-to-end model generation and manipulation, and a multimodal intelligent interaction framework for product conceptual design was constructed. According to the framework, key techniques of multimodal intelligent interaction were studied including the multimodal signal synchronous acquisition, situation model construction and multimodal signal fusion on the level of feature and decision. On this basis, a multimodal intelligent interaction system based on brain-eye-hand was built and two typical application cases were provided to prove the feasibility of the framework and key technologies proposed in this paper. It provided ideas and technical means for the realization of a new generation of CAD intelligent interactive system.