A view-dependent stereoscopic system using depth-image-based tracking

With the development of inexpensive depth cameras and stereo displays, augmented reality systems that blend physical reality and virtual objects become affordable for everyone. Unlike most existing stereoscopic systems that display the same imagery when watched from distinct directions, we present a system that tracks user's head. Realtime images are rendered according to the viewing position. Dynamic images will be displayed on to the screen so we can see different parts of a virtual object when wearing a pair of polarized glasses. A palm-based interaction is introduced so that user can manipulate the virtual object, this creates a more vivid illusion that a real object is set at the physical scene. We also run a simple test to assess the visual comfort of this system.