引入多状态记忆机制的迭代软阈值学习算法及其应用

Learned Iterative Soft-Thresholding Algorithm with Multi-state Memory Mechanism and Its Application

  • 摘要: 迭代软阈值学习算法(Learned Iterative Soft-Thresholding Algorithm,LISTA)将迭代软阈值算法(Iterative Soft-Thresholding Algorithm,ISTA)展开为递归前馈神经网络优化稀疏恢复的求解。针对LISTA单次迭代只依赖于前一迭代点限制算法收敛速率的问题,本文提出了一种引入多状态记忆机制的迭代软阈值学习算法(Learned Iterative Soft-Thresholding Algorithm with Multi-state Memory Mechanism,LISTA-MM)。该算法基于一阶迭代固定步长算法对LISTA进行改进,设置状态连接度数,选择性地组合多个先前迭代点的稀疏信息,确保了迭代过程中信息被正确传递并充分利用,进而加快了算法的收敛速度。实验结果表明,LISTA-MM在保证稀疏恢复精度的同时有效提高了收敛速度。此外,本文将LISTA-MM扩展为卷积形式,并探索其在图像超分辨率中的应用,实验结果表明,基于LISTA-MM的网络在图像质量评价指标和可视化效果上均优于其他网络,重构图像具有与原始图像相近的清晰细节纹理。

     

    Abstract: Learned iterative soft-thresholding algorithm (LISTA) expands the iterative soft-thresholding algorithm (ISTA) into a recursive feedforward neural network to optimize the solution of sparse recovery. To address the problem that each iteration in LISTA only relies on the previous iteration point resulting in the limitation of convergence rate, this paper proposes a learned soft-thresholding algorithm with multi-state memory mechanism (LISTA-MM). This method improves LISTA based on the first-order iterative fixed-step algorithm and sets the state connection degree. This algorithm selectively combines the sparse information of several previous iteration points, ensures that the sparse information is transferred correctly and fully utilized during the iteration, and thus speeds up the convergence speed of the algorithm. The experimental results show that LISTA-MM not only ensures the precision of sparse recovery, but also effectively improves the convergence rate of sparse recovery. In addition, this paper extends LISTA-MM into a convolution manner and explores its application in image super-resolution. The experimental results show that the LISTA-MM based network is superior to other networks in both image quality evaluation and visualization effect, and the reconstructed images have clear and detail texture closing to the original image.

     

/

返回文章
返回