基于光电-雷达双模态融合的弱小目标检测方法
Weak Small Target Detection Method Based on Electro-Optical and Radar Dual-Modal Fusion
-
摘要: 红外弱小目标检测在复杂背景下由于目标尺度极小、信噪比低以及背景噪声强等挑战,始终是计算机视觉领域中的难题。现有的大多数检测方法主要针对通用目标设计,未能充分考虑弱小目标的特殊性,且难以有效融合跨模态信息。为此,本文提出了一种基于光电与雷达双模态的弱小目标检测框架,旨在克服现有方法的不足,增强目标的可检测性和定位精度。首先,设计了细节与语义空频感知融合模块,结合空域、频域和语义信息,提升弱小目标的特征表达能力;其次,引入动态编解码特征融合模块,增强多尺度特征的交互与融合能力,并通过模态特定混合注意力模块强化弱小目标区域的上下文建模。为了解决小目标回归不稳定问题,提出了弱小目标感知损失函数,以提高预测框的稳定性;最后,设计了混合专家特征对齐决策系统,实现了红外与雷达信息的有效协同融合,提升了整体检测的鲁棒性。实验结果表明,本文方法在IRSTD-1K和NUDT-SIRST数据集上均取得了优于现有方法的检测性能,验证了所提出框架在弱小目标检测中的有效性和优势。Abstract: Infrared weak small target detection in complex backgrounds remains challenging in the field of computer vision owing to issues such as an extremely small target scale, a low signal-to-noise ratio, and strong background noise. Most existing detection methods are primarily designed for general targets and do not fully consider the specific characteristics of weak small targets, nor can they effectively fuse cross-modal information. To address these issues, this study proposed a weak small target detection framework based on electro-optical and radar dual-modal fusion, with the aim of overcoming the limitations of existing methods and enhancing target distinguishability and localization accuracy. First, a detailed and semantic space-frequency fusion module was designed, which combined spatial, frequency, and semantic information to enhance the feature representation capability of weak small targets. Second, a dynamic encoding-decoding feature fusion module was introduced to enhance the interaction and fusion of multi-scale features. In addition, a modality-specific hybrid attention module was employed to strengthen the contextual modeling of weak small target regions. To address the issue of small target regression instability, a weak small target-aware loss function was proposed to improve the stability of predicted bounding boxes. Finally, a hybrid expert feature alignment decision system was designed to achieve effective collaborative fusion of infrared and radar information, thereby enhancing the robustness of the overall detection. Experimental results showed that the proposed method outperformed existing methods in terms of detection performance on the IRSTD-1K and NUDT-SIRST datasets, validating the effectiveness and advantages of the framework for weak small target detection.
下载: