基于空间感知多维度距离增强网络的3D目标检测
Spatial-Aware Multi-Dimensional Range-Enhanced Networks for Efficient 3D Object Detection
-
摘要: 基于虚拟点的三维(Three-Dimensional,3D)目标检测是一种利用深度补全技术实现RGB图像与激光雷达数据融合的视觉检测方法。然而,该方法所生成的高密度点云每帧可达60万个检测点,如此大量的数据在实时部署时对算法提出了严格的高效需求。现有方法依赖单维度空间假设,将邻近区域视为均匀冗余并采用随机丢弃策略,导致其无法捕获由空间位置、语义类别和特征质量共同决定的真实冗余分布,造成计算资源的浪费。因此,本文提出空间感知多维度距离增强网络(Spatial-aware Multi-dimensional Range-enhanced Networks,SMR-3D)。该网络构建了一种多维度联合建模框架,统一优化空间、语义和距离相关的特征维度,高效利用计算资源。在数据层面,SMR-3D通过空间感知采样(Spatial-Aware Sampling,SAS)和多维度重要性评分采样(Multi-dimensional Importance Scoring Sampling,MISS)来提升采样效率。SAS将3D空间划分为近、中、远三个距离区域,根据距离远近设置不同的体素丢弃率,近距离区域采用较高丢弃率以减少冗余,远距离区域采用较低丢弃率以保留本就稀疏的关键体素;MISS通过建模反射率、高度、方向和距离四个属性的语义参数,并学习每个属性的重要性,使得优先保留具有目标特征的关键体素。在特征层面,距离感知网络(Range-aware Network,RangeNet)使用可学习的距离区间和软分配机制,通过通道级自适应加权来补偿特征随距离增加而产生的退化问题。最后,在KITTI验证集上的实验表明,SMR-3D在中等难度级别上取得了84.07%的3D平均精度(Average Precision,AP),相比随机采样基线提升1.72个百分点,推理时间为54 ms。定性分析显示,SMR-3D成功检测到基线方法在远距离处遗漏的目标车辆,在自动驾驶应用中实现了检测精度与实时性的良好平衡。Abstract: Virtual point-based 3D object detection is a visual detection method that fuses RGB images and LiDAR data through depth completion techniques. However, the high-density point clouds generated by this method can contain up to 600000 detection points per frame, imposing strict efficiency requirements on algorithms during real-time deployment. Existing methods rely on single-dimensional spatial assumptions, treating nearby regions as uniformly redundant and adopting random discarding strategies. Such approaches fail to capture the true redundancy distribution jointly determined by spatial location, semantic category, and feature quality, resulting in inefficient use of computational resources. To address this issue, this study proposes spatial-aware multi-dimensional range-enhanced networks (SMR-3D). This network constructs a multi-dimensional joint modeling framework that unifies the optimization of spatial, semantic, and range-dependent feature dimensions to improve computational efficiency. At the data level, SMR-3D improves sampling efficiency through spatial-aware sampling (SAS) and multi-dimensional importance scoring sampling (MISS). SAS partitions the 3D space into near-, mid-, and far-range regions, assigning different voxel discard rates according to distance, with higher discard rates for near-range regions to reduce redundancy and lower discard rates for far-range regions to preserve inherently sparse critical voxels. MISS model semantic parameters of four attributes—reflectance, height, orientation, and distance—and learns the importance of each attribute to prioritize the retention of critical voxels with target-characteristic features. At the feature level, the range-aware network (RangeNet) employs learnable distance bins and a soft assignment mechanism to compensate for feature degradation caused by increasing distance through channel-wise adaptive weighting. Finally, experiments on the KITTI validation set demonstrate that SMR-3D achieves 84.07% 3D average precision (AP) at the moderate difficulty level, representing a 1.72 percentage point improvement over the random sampling baseline, with an inference time of 54 ms. Qualitative analysis shows that SMR-3D successfully detects target vehicles at distant ranges that are missed by the baseline method, achieving a favorable balance between detection accuracy and real-time performance in autonomous driving applications.
下载: