TY - GEN
T1 - HandAttNet
T2 - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
AU - Sun, Jintao
AU - Ding, Gangyi
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Hand pose estimation and reconstruction become increasingly compelling in the metaverse era. But in reality hands are often heavily occluded, which makes the estimation of occluded 3D hand meshes challenging.Previous work tends to ignore the information of the occluded regions, we believe that the occluded regions hand information can be highly utilized, Therefore, in this study, we propose hand mesh estimation network, HandAttNet.We design the cross-attention mechanism module and the DUO-FIT module to inject hand information into the occluded region.Finally, we use the self-attention regression module for 3D hand mesh estimation.Our HandAttNet achieves SOTA performance.
AB - Hand pose estimation and reconstruction become increasingly compelling in the metaverse era. But in reality hands are often heavily occluded, which makes the estimation of occluded 3D hand meshes challenging.Previous work tends to ignore the information of the occluded regions, we believe that the occluded regions hand information can be highly utilized, Therefore, in this study, we propose hand mesh estimation network, HandAttNet.We design the cross-attention mechanism module and the DUO-FIT module to inject hand information into the occluded region.Finally, we use the self-attention regression module for 3D hand mesh estimation.Our HandAttNet achieves SOTA performance.
UR - http://www.scopus.com/inward/record.url?scp=85159663751&partnerID=8YFLogxK
U2 - 10.1109/VRW58643.2023.00165
DO - 10.1109/VRW58643.2023.00165
M3 - Conference contribution
AN - SCOPUS:85159663751
T3 - Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
SP - 645
EP - 646
BT - Proceedings - 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 25 March 2023 through 29 March 2023
ER -