TY - JOUR
T1 - CoKNet
T2 - Colorized key-instance guided fusion for 3D object detection
AU - Chang, Xiangzhen
AU - Yu, Zhuochen
AU - Yau, David K.Y.
AU - Yan, Liping
AU - Xia, Yuanqing
N1 - Publisher Copyright:
Copyright © 2026. Published by Elsevier B.V.
PY - 2026/11
Y1 - 2026/11
N2 - Fusing LiDAR with virtual points generated by depth completion from RGB images and LiDAR has emerged as a promising direction for 3D object detection. However, it remains challenging to balance dense geometric coverage, reliable instance-level semantics, and robustness to noisy virtual points. To address these issues, we propose CoKNet , a colorized key-instance guided fusion network. CoKNet consists of two key designs: KICP (Key Instance Guided Color Painting), which establishes instance-level anchors by enriching LiDAR points with depth-consistent color information from CKIs, and KIGF (Key Instance Guided Fusion), which leverages these anchors to achieve complementary perception between instance and global features through progressive BEV–RoI fusion. Experiments on the KITTI and nuScenes benchmarks demonstrate that CoKNet improves 3D detection performance over recent LiDAR–camera fusion methods, particularly in long-range, occluded, and image-degraded scenarios.
AB - Fusing LiDAR with virtual points generated by depth completion from RGB images and LiDAR has emerged as a promising direction for 3D object detection. However, it remains challenging to balance dense geometric coverage, reliable instance-level semantics, and robustness to noisy virtual points. To address these issues, we propose CoKNet , a colorized key-instance guided fusion network. CoKNet consists of two key designs: KICP (Key Instance Guided Color Painting), which establishes instance-level anchors by enriching LiDAR points with depth-consistent color information from CKIs, and KIGF (Key Instance Guided Fusion), which leverages these anchors to achieve complementary perception between instance and global features through progressive BEV–RoI fusion. Experiments on the KITTI and nuScenes benchmarks demonstrate that CoKNet improves 3D detection performance over recent LiDAR–camera fusion methods, particularly in long-range, occluded, and image-degraded scenarios.
KW - 3D object detection
KW - LiDAR–camera fusion
KW - Virtual point
UR - https://www.scopus.com/pages/publications/105050467320
U2 - 10.1016/j.patrec.2026.09.013
DO - 10.1016/j.patrec.2026.09.013
M3 - Article
AN - SCOPUS:105050467320
SN - 0167-8655
VL - 209
SP - 188
EP - 193
JO - Pattern Recognition Letters
JF - Pattern Recognition Letters
ER -