Navigation system for endoscopic sinus surgery based on augmented reality

Against the possibility of complications in the endoscopic sinus surgery, a navigation system based on augmented reality is presented. The proposed system overlays 3D models of the brain, eyeballs and blood vessel onto the view of the endoscope. It can remind the surgeon of dangerous areas of the patient and reduce the possibility of complications. The patient needs to be scanned by CT or MRI before the surgery. The system applies segmentation and reconstruction to the scan results to obtain 3D models of organs in the patient's head. 3D scanner scans the patient's face and gets the 3D data. The system adopts DLT algorithm to align CT coordinate system and optical tracking device coordinate system to 3D scanner coordinate system. The optical tracking device tracks the endoscope during the surgery. The system blends the real and virtual information according to the calibration results. Verified through an experiment, the system can obtain a sub millimeter precision. This level of precision is appropriate for the requirements of actual surgery.