利用结构化和一致性约束的稀疏表示模型进行红外和可见光图像融合

Infrared and Visible Image Fusion Method Based on Sparse Representation with Structured and Spatial Consistency Constraints

  • 摘要: 红外和可见光图像融合作为图像融合技术中一个重要组成部分,被广泛应用于军事、工业和生活领域。它能够集成两种模态图像的互补信息,融合成一幅信息丰富、质量较好的图像,不仅能够突出目标信息,还能够保持源有图像的纹理信息和一些显著性的细节。本文提出一种新的红外和可见光图像融合方法,在鲁棒稀疏表示模型的基础上增加了结构化稀疏约束,同时结合了图像区域特征相似的一致性约束项,克服现有一些方法所存在的局部模糊和纹理细节丢失等问题,提高了图像融合的精度。本文主要构建了结构化稀疏表示与一致性约束模型,将其应用到红外和可见光图像融合中并进行了求解,将源图像分解为背景信息和显著性信息,再对背景和显著性信息分别设计融合规则,最后利用字典进行重构,获得红外和可见光融合后的图像。实验结果表明,本文提出的融合算法优于现有的一些多聚焦图像融合算法。

     

    Abstract: As an important part of image fusion technology, infrared and visible image fusion is widely used in military, industrial and civilian applications. It can integrate the complementary information of two modal images and fuse them into an image with abundant information and higher quality. It can not only highlight the target information, but also retain the texture and detail information of the scene. In this paper, a new infrared and visible image fusion method is proposed. Structured sparse constraint are exerted on the robust sparse representation model and consistency constraints of local region similarity are combined simultaneously, so that it can overcome the problems of local blurring and loss of texture details in some existing methods and improve the precision of image fusion. A structured sparse representation and consistency constraints model is first constructed, which is solved and is applied to infrared and visible image fusion simultaneously. Then the source images are decomposed into background information and saliency information. Then the fusion rules are designed for background and saliency information, respectively. Finally, and reconstruction is carried out by using the dictionary to get the final fusion. Experimental results demonstrate that the fusion algorithm proposed in this paper consistently outperforms existing state-of-art methods in terms of both visual and quantitative evaluations.

     

/

返回文章
返回