ISarProjection: A kinectfusion based handheld dynamic spatial augmented reality system

Mengwen Tan; Weipeng Xu; Dongdong Weng

doi:10.1109/CADGraphics.2013.79

ISarProjection: A kinectfusion based handheld dynamic spatial augmented reality system

Mengwen Tan, Weipeng Xu, Dongdong Weng

School of Optics and Photonics

Beijing Institute of Technology

Research output: Contribution to conference › Paper › peer-review

4 Citations (Scopus)

Abstract

We introduce a general technique of dynamically augmenting physical models. Using a handheld projector attached with an RGBD camera, we map the physical model with corresponding textures, and develop a real-time dynamic spatial augmented reality (SAR) system named iSarProjection. Compared to traditional huge and complex tracking system, this technique, based on KinectFusion, supports precise registration between the physical model point cloud and the reconstructed 3D scene, and provides real-time pose estimation to track the physical display surface effectively. Through projecting medical anatomy visualizations on a white body model, it presents that we ease the development of dynamic SAR system and make it possible to be applied in various research fields.

Original language	English
Pages	425-426
Number of pages	2
DOIs	https://doi.org/10.1109/CADGraphics.2013.79
Publication status	Published - 2013
Event	13th International Conference on Computer-Aided Design and Computer Graphics, CAD/Graphics 2013 - Hong Kong, China Duration: 16 Nov 2013 → 18 Nov 2013

Conference

Conference	13th International Conference on Computer-Aided Design and Computer Graphics, CAD/Graphics 2013
Country/Territory	China
City	Hong Kong
Period	16/11/13 → 18/11/13

Keywords

Dynamic Projection
KinectFusion
Medical AR
Spatial Augmented Reality

Access to Document

10.1109/CADGraphics.2013.79

Cite this

@conference{9628971e98474c9e99d6e788bd6cfd7c,

title = "ISarProjection: A kinectfusion based handheld dynamic spatial augmented reality system",

abstract = "We introduce a general technique of dynamically augmenting physical models. Using a handheld projector attached with an RGBD camera, we map the physical model with corresponding textures, and develop a real-time dynamic spatial augmented reality (SAR) system named iSarProjection. Compared to traditional huge and complex tracking system, this technique, based on KinectFusion, supports precise registration between the physical model point cloud and the reconstructed 3D scene, and provides real-time pose estimation to track the physical display surface effectively. Through projecting medical anatomy visualizations on a white body model, it presents that we ease the development of dynamic SAR system and make it possible to be applied in various research fields.",

keywords = "Dynamic Projection, KinectFusion, Medical AR, Spatial Augmented Reality",

author = "Mengwen Tan and Weipeng Xu and Dongdong Weng",

year = "2013",

doi = "10.1109/CADGraphics.2013.79",

language = "English",

pages = "425--426",

note = "13th International Conference on Computer-Aided Design and Computer Graphics, CAD/Graphics 2013 ; Conference date: 16-11-2013 Through 18-11-2013",

}

TY - CONF

T1 - ISarProjection

T2 - 13th International Conference on Computer-Aided Design and Computer Graphics, CAD/Graphics 2013

AU - Tan, Mengwen

AU - Xu, Weipeng

AU - Weng, Dongdong

PY - 2013

Y1 - 2013

N2 - We introduce a general technique of dynamically augmenting physical models. Using a handheld projector attached with an RGBD camera, we map the physical model with corresponding textures, and develop a real-time dynamic spatial augmented reality (SAR) system named iSarProjection. Compared to traditional huge and complex tracking system, this technique, based on KinectFusion, supports precise registration between the physical model point cloud and the reconstructed 3D scene, and provides real-time pose estimation to track the physical display surface effectively. Through projecting medical anatomy visualizations on a white body model, it presents that we ease the development of dynamic SAR system and make it possible to be applied in various research fields.

AB - We introduce a general technique of dynamically augmenting physical models. Using a handheld projector attached with an RGBD camera, we map the physical model with corresponding textures, and develop a real-time dynamic spatial augmented reality (SAR) system named iSarProjection. Compared to traditional huge and complex tracking system, this technique, based on KinectFusion, supports precise registration between the physical model point cloud and the reconstructed 3D scene, and provides real-time pose estimation to track the physical display surface effectively. Through projecting medical anatomy visualizations on a white body model, it presents that we ease the development of dynamic SAR system and make it possible to be applied in various research fields.

KW - Dynamic Projection

KW - KinectFusion

KW - Medical AR

KW - Spatial Augmented Reality

UR - http://www.scopus.com/inward/record.url?scp=84901421052&partnerID=8YFLogxK

U2 - 10.1109/CADGraphics.2013.79

DO - 10.1109/CADGraphics.2013.79

M3 - Paper

AN - SCOPUS:84901421052

SP - 425

EP - 426

Y2 - 16 November 2013 through 18 November 2013

ER -

ISarProjection: A kinectfusion based handheld dynamic spatial augmented reality system

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this