TY - GEN
T1 - A browser-based perceptual experiment platform for visual search study in augmented reality system
AU - Feng, Dan
AU - Weng, Dongdong
AU - Lu, Weiquan
AU - Sun, Chenchen
AU - Do, Ellen Yi Luen
PY - 2013
Y1 - 2013
N2 - This paper describes a real-time experiment platform for visual search in Augmented Reality (AR). Searching for a virtual object embedded in an AR environment is an example of a visual search task. However, systems implemented in the previous visual search studies have focused on static images and pre-recorded videos. Our system supports real-time video captured from a camera mounted in a Head-Worn-Display (HWD) as input. The system allows customization by the experiment administrator according to their specific requirements. A visual clutter analysis method known as Feature Congestion is utilized to analyze the visual clutter of video scene and optimized trying to meet the requirements of real-time operation. Different optimization techniques such as multithreading, general computation using GPU, fast matrix convolution are explored. The theoretical improvement and limitations of the optimizations have been discussed. By utilizing JavaScript and HTML, this browser-based platform is designed to be cross-platform and extensible. Many state-of-art HTML5 technologies are employed in the system to both improve the computation performance and strengthen the interactions between users and system.
AB - This paper describes a real-time experiment platform for visual search in Augmented Reality (AR). Searching for a virtual object embedded in an AR environment is an example of a visual search task. However, systems implemented in the previous visual search studies have focused on static images and pre-recorded videos. Our system supports real-time video captured from a camera mounted in a Head-Worn-Display (HWD) as input. The system allows customization by the experiment administrator according to their specific requirements. A visual clutter analysis method known as Feature Congestion is utilized to analyze the visual clutter of video scene and optimized trying to meet the requirements of real-time operation. Different optimization techniques such as multithreading, general computation using GPU, fast matrix convolution are explored. The theoretical improvement and limitations of the optimizations have been discussed. By utilizing JavaScript and HTML, this browser-based platform is designed to be cross-platform and extensible. Many state-of-art HTML5 technologies are employed in the system to both improve the computation performance and strengthen the interactions between users and system.
KW - Augmented Reality
KW - Browser-based Experiment Platform
KW - HTML5 and Javascript
KW - Visual Search
UR - http://www.scopus.com/inward/record.url?scp=84894155335&partnerID=8YFLogxK
U2 - 10.1109/UIC-ATC.2013.21
DO - 10.1109/UIC-ATC.2013.21
M3 - Conference contribution
AN - SCOPUS:84894155335
SN - 9781479924813
T3 - Proceedings - IEEE 10th International Conference on Ubiquitous Intelligence and Computing, UIC 2013 and IEEE 10th International Conference on Autonomic and Trusted Computing, ATC 2013
SP - 466
EP - 473
BT - Proceedings - IEEE 10th International Conference on Ubiquitous Intelligence and Computing, UIC 2013 and IEEE 10th International Conference on Autonomic and Trusted Computing, ATC 2013
T2 - 10th IEEE International Conference on Ubiquitous Intelligence and Computing, UIC 2013 and 10th IEEE International Conference on Autonomic and Trusted Computing, ATC 2013
Y2 - 18 December 2013 through 21 December 2013
ER -