TY - JOUR
T1 - 面向产品概念设计的多模态智能交互框架及实现
AU - Niu, Hongwei
AU - Hao, Jia
AU - Cao, Beining
AU - Long, Hui
AU - Zhang, Fei fan
AU - Wang, Guoxin
N1 - Publisher Copyright:
© 2022 CIMS. All rights reserved.
PY - 2022/8/31
Y1 - 2022/8/31
N2 - The traditional interaction mode of Computer Aided Design (CAD) based on "mouse+keyboard" is not conducive to the natural expression of design thinking. Facing the development demand of intelligent human-computer interaction technology in product conceptual design, an intelligent interaction mode was explored based on end-to-end model generation and manipulation, and a multimodal intelligent interaction framework for product conceptual design was constructed. According to the framework, key techniques of multimodal intelligent interaction were studied including the multimodal signal synchronous acquisition, situation model construction and multimodal signal fusion on the level of feature and decision. On this basis, a multimodal intelligent interaction system based on brain-eye-hand was built and two typical application cases were provided to prove the feasibility of the framework and key technologies proposed in this paper. It provided ideas and technical means for the realization of a new generation of CAD intelligent interactive system.
AB - The traditional interaction mode of Computer Aided Design (CAD) based on "mouse+keyboard" is not conducive to the natural expression of design thinking. Facing the development demand of intelligent human-computer interaction technology in product conceptual design, an intelligent interaction mode was explored based on end-to-end model generation and manipulation, and a multimodal intelligent interaction framework for product conceptual design was constructed. According to the framework, key techniques of multimodal intelligent interaction were studied including the multimodal signal synchronous acquisition, situation model construction and multimodal signal fusion on the level of feature and decision. On this basis, a multimodal intelligent interaction system based on brain-eye-hand was built and two typical application cases were provided to prove the feasibility of the framework and key technologies proposed in this paper. It provided ideas and technical means for the realization of a new generation of CAD intelligent interactive system.
KW - computer aided design
KW - intelligent interaction framework
KW - multimodal
KW - product conceptual design
UR - http://www.scopus.com/inward/record.url?scp=85140891218&partnerID=8YFLogxK
U2 - 10.13196/j.cims.2022.08.021
DO - 10.13196/j.cims.2022.08.021
M3 - 文章
AN - SCOPUS:85140891218
SN - 1006-5911
VL - 28
SP - 2508
EP - 2521
JO - Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS
JF - Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS
IS - 8
ER -