Depth camera based dynamic projector calibration for Spatial Augmented Reality

A depth camera based real-time projector calibration method for dynamic projection in Spatial Augmented Reality was proposed. To achieve this, a depth camera to the projector was attached to form a projector-depth-camera system. The processing flow has two phases: an off-line calibration and initial registration phase and an on-line tracking phase. The proposed system finally generated a projection mapping between the virtual model and the real projection surface. Thus, the virtual model was aligned with the real object. A prototype system was built to validate the method. Experimental results show that the method can continuously calibrate projection in real time with good performance.