TY - GEN
T1 - An Improved YOLOv3 Object Detection Network for Mobile Augmented Reality
AU - Wang, Quanyu
AU - Wang, Zhi
AU - Li, Bei
AU - Wei, Dejian
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021/5/20
Y1 - 2021/5/20
N2 - With the spread of mobile devices such as mobile phones, MAR(Mobile augmented reality), which is a technology that realizes augmented reality on mobile devices, is becoming one of the most popular directions in augmented reality research. In MAR, the capturing and positioning of target objects, that is, tracking and registration technology is a crucial problem. In mobile devices, tracking registration technologies that use cam-eras as tracking sensors are divided into hardware sensor-based and computer vision-based tracking registration technologies. Compared with the former, the latter has the characteristics of low hardware equipment requirements and high accuracy. However, traditional computer vision-based tracking registration technologies are susceptible to factors such as background environment, distance, and angle. To overcome the weakness, our research combines the development of deep learning in the field of object detection and lightens YOLOV3 network, which includes simplifying the network structure, improving multi-scale feature fusion detection, optimizing the dimensions of candidate frames through clustering, and optimizing the loss function, so that the object detection network can be used on mobile devices with guaranteed accuracy, and reduces the influence of background environment and other factors on the visual tracking registration technology. Our research realizes a mobile augmented reality system based on the IOS system, which achieves state-of-the-art performance.
AB - With the spread of mobile devices such as mobile phones, MAR(Mobile augmented reality), which is a technology that realizes augmented reality on mobile devices, is becoming one of the most popular directions in augmented reality research. In MAR, the capturing and positioning of target objects, that is, tracking and registration technology is a crucial problem. In mobile devices, tracking registration technologies that use cam-eras as tracking sensors are divided into hardware sensor-based and computer vision-based tracking registration technologies. Compared with the former, the latter has the characteristics of low hardware equipment requirements and high accuracy. However, traditional computer vision-based tracking registration technologies are susceptible to factors such as background environment, distance, and angle. To overcome the weakness, our research combines the development of deep learning in the field of object detection and lightens YOLOV3 network, which includes simplifying the network structure, improving multi-scale feature fusion detection, optimizing the dimensions of candidate frames through clustering, and optimizing the loss function, so that the object detection network can be used on mobile devices with guaranteed accuracy, and reduces the influence of background environment and other factors on the visual tracking registration technology. Our research realizes a mobile augmented reality system based on the IOS system, which achieves state-of-the-art performance.
KW - deep learning
KW - mobile augmented reality
KW - object detection
KW - tracking registration technology
UR - http://www.scopus.com/inward/record.url?scp=85111445554&partnerID=8YFLogxK
U2 - 10.1109/ICVR51878.2021.9483829
DO - 10.1109/ICVR51878.2021.9483829
M3 - Conference contribution
AN - SCOPUS:85111445554
T3 - International Conference on Virtual Rehabilitation, ICVR
SP - 332
EP - 339
BT - 2021 IEEE 7th International Conference on Virtual Reality, ICVR 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 7th IEEE International Conference on Virtual Reality, ICVR 2021
Y2 - 20 May 2021 through 22 May 2021
ER -