面向统计特性一致的深度图像修复方法

Towards Statistical Consistency for Deep Image Inpainting

  • 摘要: 本文提出了一种改善深度修复图像统计特性一致性的方法。首先,分别采用非线性高通滤波残差及深度神经网络提取固有身份信号(intrinsic identity signal, IIS),发现深度修复图像和真实图像存在IIS统计特性差异,验证在不同来源图像和不同的深度修复算法的条件下统计特性不一致性是普遍存在的。其次,提出一个生成型卷积神经网络,优化修复区域,保证修复图像的视觉质量,使其与真实区域IIS统计特性保持一致。最后,通过在合理范围内对生成网络的部分参数进行随机扰动,生成具有模式多样性的图像,有效降低生成图像被识别来源的概率。通过对比真实图像、深度修复图像、生成图像的IIS统计特性,以及在取证检测器上的对抗检测实验,表明了本文方法的有效性。

     

    Abstract: A method of improving the statistical consistency for deep inpainted images is proposed. Firstly, non-linear high-pass filtered residuals and a deep neural network are respectively used to extract intrinsic identity signal (IIS). It is found that there is IIS statistical inconsistency between the deep inpainted images and the pristine images, and such statistical inconsistency universally exists for different image sources and different deep inpainting algorithms. Secondly, a generative convolutional neural network is proposed to make the IIS statistics of inpainted regions be consistent with that of the pristine-regions, while maintaining high visual quality. Finally, by randomly perturbing some parameters of the generation network within a reasonable range, images with diverse patterns can be generated. It can reduce the detection accuracy of their sources being identified. The effectiveness of the proposed method is demonstrated by comparing the IIS statistics among pristine images, deep inpainted images and generated images, and evaluated by various kind of forensic detectors.

     

/

返回文章
返回