面向目标再辨识的空间和通道双重显著性挖掘算法

Spatial and Channel Dual Significance Mining Algorithm for Object Re-identification

  • 摘要: 现有的目标再辨识方法常用全局特征池化层来聚合深度骨干网络所提取的特征映射以得到最终的图像特征。但是,全局特征池化层忽视了特征映射在空间和通道上的显著性,会限制所得图像特征的鉴别能力。为此,本文设计一个新颖的空间和通道双重显著性挖掘(Spatial Channel Dual Significance Mining, SC-DSM)模块,用于同时从空间和通道两个维度上充分挖掘特征映射的显著性,从而改善所得图像特征的鉴别能力,以提升目标再辨识的准确性。SC-DSM模块包含空间显著性挖掘子模块和通道显著性挖掘子模块。其中,空间显著性挖掘子模块在特征映射上构建空间图,聚合空间维度上的邻居节点特征并学习权重,实现空间显著性挖掘;通道显著性挖掘子模块在特征映射建立通道图聚合通道维度上的邻居节点并学习权重,实现通道显著性挖掘。实验结果表明,在目前最流行的车辆再辨识数据库VeRi776和行人再辨识数据库Market-1501上,所提出的方法能够优于现有的目标再辨识方法。

     

    Abstract: Existing object re-identification methods usually use global feature pooling layers to aggregate feature maps extracted via deep backbone networks to obtain the final image features. However, global feature pooling layers ignore the spatial and channel significance of feature maps, restricting the discriminative ability of the final image features. For that, in this paper, a spatial channel dual significance mining (SC-DSM) module is designed to comprehensively exploit the feature map’s significance from both spatial and channel dimensions to enhance the feature’s discriminative ability, thereby improving the object re-identification accuracy. The SC-DSM module consists of a spatial significance mining (SSM) sub-module and a channel significance mining (CSM) sub-module. On feature maps, the SSM sub-module builds spatial graphs to aggregate spatial neighbor nodes’ features and learn weights to exploit the spatial significance, while the CSM sub-module constructs channel graphs to aggregate channel neighbor nodes’ features and learn weights to mine the channel significance. Experimental results show that proposed method can outperform existing object re-identification methods on the most popular vehicle re-identification dataset, namely, VeRi776 and person re-identification dataset, namely, Market-1501.

     

/

返回文章
返回