Design and implementation of scenic-spot introduction-task-oriented 3D virtual human spoken dialogue system

A scenic-spot introduction-task-oriented 3D virtual human spoken dialogue system-EasyGuide is introduced. The system includes five modules: natural language processing, task domain knowledge database, dialogue management, voice processing and 3D virtual human text-to-visual speech synthesis. In the first module, dictionary construction along with sentence analysis and semantic representation are illustrated specifically. A tree-structured knowledge database is designed for the task domain. A novel framework based on the keyword analysis and context constraints is proposed as the dialogue management. As for voice processing module, a software development kit which performs speech recognition and synthesis is introduced briefly. In the last module, 3D viseme synthesis is explained with examples and a text-driven facial animation system is presented. Evaluation results show that the system can achieve satisfactory performance.