基于知识蒸馏与轻量化模型的伪装目标检测

Efficient Camouflaged Object Detection via Knowledge Distillation and Lightweight Network Design

  • 摘要: 伪装目标检测(Camouflaged Object Detection, COD)能够有效识别伪装在复杂背景中的目标,是影响计算机视觉系统性能的关键因素,广泛应用于智能安全监控、智能环境检测和智能感知等领域,具有重要的应用价值。随着深度学习技术的迅速发展,基于深度神经网络(Deep Neural Networks, DNNs)的伪装目标检测算法在检测性能上取得了显著提升。然而,当前基于DNNs的伪装目标检测算法通常依赖大参数量模型,造成检测效率低下并增加计算开销。针对这一问题,本文提出了一种高效且轻量化的伪装目标检测算法EfficientCOD。EfficientCOD的核心轻量化模块包括:跨尺度非对称深度可分离卷积洗牌与选择模块(Cross-Scale Asymmetric Depthwise Convolutional Shuffle-Selection Module, CS-ADCS2M),实现低参数量下的高效跨尺度特征交互,进而实现对不同尺度伪装目标的更强的特征感知与表达能力;解码阶段的层次化多头非对称深度可分离卷积洗牌与选择模块(Hierarchical Multi-Head Asymmetric Depthwise Convolutional Shuffle-Selection Module, HMH-ADCS2M),实现低参数量下的高效上下文感知与语义融合,能够增强模型对伪装目标与背景间微妙边界及复杂纹理的分辨能力。此外,针对轻量化模型通常在特征表达能力上弱于大容量、大参数量模型的问题,本文进一步构建了一种结构感知与语义一致性协同的伪装目标检测蒸馏框架(Structure-aware and Semantic-consistent Distillation for Camouflaged Object Detection, SaScD-COD)。SaScD-COD以高容量MambaCOD 为教师模型,从细粒度边界结构到高层语义表征实现分层、多阶段的知识迁移,使EfficientCOD在不增加推理成本的前提下有效继承MambaCOD的表达能力,从而在检测性能与模型效率之间取得更优的平衡。实验结果表明,在CHAMELEON、CAMO、COD10K和NC4K数据集上,EfficientCOD以31.4% (15.01M)的参数量实现了接近参数量为47.8M的教师网络MambaCOD的性能,展示出卓越的检测精度与效率,为高效伪装目标检测提供了新的设计范式。

     

    Abstract: Camouflaged object detection (COD) aims to accurately identify objects concealed within complex backgrounds and is a critical factor affecting the performance of computer vision systems. It has significant application value in intelligent security surveillance, environmental perception, and smart monitoring. With the rapid development of deep learning, deep neural network (DNN)-based COD algorithms have achieved remarkable performance improvements. However, existing DNN-based COD methods typically rely on models with a large number of parameters, leading to low inference efficiency and high computational cost. To address these challenges, this study proposes EfficientCOD, a highly efficient and lightweight COD framework. The core lightweight modules of EfficientCOD include: (1) the cross-scale asymmetric depthwise convolutional shuffle-selection module (CS-ADCS2M), which enables efficient cross-scale feature interaction with a reduced number of parameters, thereby enhancing the model’s capability to represent camouflaged objects at varying scales; and (2) the hierarchical multi-head asymmetric depthwise convolutional shuffle-selection module (HMH-ADCS2M), which facilitates hierarchical context encoding and semantic fusion during decoding, strengthening boundary discrimination and fine-grained texture perception between camouflaged objects and their surroundings. Moreover, because lightweight models generally have weaker feature representation capability than large-capacity models, we further design a structure-aware and semantic-consistent distillation framework for COD (SaScD-COD). Using the high-capacity MambaCOD as the teacher network, SaScD-COD performs multi-stage knowledge transfer from fine-grained structural cues to high-level semantic representations. This enables EfficientCOD to inherit the strong representation ability of MambaCOD without increasing inference cost, thereby achieving a superior balance between detection accuracy and model efficiency. Extensive experiments on the CHAMELEON, CAMO, COD10K, and NC4K benchmarks demonstrate that EfficientCOD achieves comparable performance to the 47.8M-parameter teacher model MambaCOD while using only 31.4% (15.01M) of its parameters, delivering strong detection accuracy and computational efficiency. These results establish EfficientCOD as a new paradigm for efficient COD.

     

/

返回文章
返回