Virtual reality aided maintenance training based on real-time assembly state perception and intuitive interaction

In order to improve positioning accuracy of parts in virtual maintenance training, enrich human-computer interaction functions, reflect the closer to actual operation processes, and improve training quality of operator, the assembly constraint perception and establishment algorithm was analyzed based on virtual reality aided technology. The correct assembly constraint could be established in real time according to the current assembly state. Based on intuitive interactions, the multi-mode guidance method of “tutor & teaching assistant”was established. The unmarked interaction operation modes of virtual hand and virtual tools were developed in Unity3D environment. The virtual environment stereoscopic visualization was realized by HMD(head-mounted display). A virtual maintenance training system was developed and its test was performed taking a washing machine as the object. The results showed that this system could make the positioning of assembly relation of parts more accurate, simulate more realistic disassembly processes and help operator complete tasks better through intuitive interaction, which can eliminate shortage of actual training and greatly improve the maintenance training cost-effectiveness ratio.