|
|
基于频域自适应增强稀疏先验与图正则化的盲图像去模糊方法
|
Abstract:
盲图像去模糊旨在从模糊观测中恢复清晰图像,且不依赖任何模糊核先验知识。与依赖大规模数据训练的深度学习方法不同,该问题本质上属于小样本逆问题,其核心挑战在于如何从单幅图像或有限样本中有效估计未知的模糊核,而非通过大量训练数据学习模糊与清晰映射关系。本文基于卷积操作会降低图像高频稀疏性这一观测,提出一种面向模糊核估计的新型频域自适应增强正则化先验(Adaptive Frequency-Domain Tuning for Sparse-Based Prior, AFTS)。该先验通过频域自适应增强与非线性激活机制,有效捕捉图像模糊过程中的高频特征退化规律。我们将AFTS先验嵌入最大后验概率估计框架,构建了清晰图像与模糊核的联合优化模型,并采用半二次分裂与坐标下降策略实现高效求解。在多个标准数据集上的实验表明,本方法在PSNR、SSIM等客观指标上与主流盲去模糊算法性能相当,且在计算效率方面具备明显优势,为以后高效图像的复原提供了可行解决方案。
Blind image deblurring aims to recover sharp images from blurred observations without relying on any prior knowledge of the blur kernel. Unlike deep learning methods that depend on large-scale data training, this problem is inherently a few-shot inverse problem. Its core challenge lies in effectively estimating the unknown blur kernel from a single image or limited samples, rather than learning the mapping relationship between blurred and sharp images through massive training data. Based on the observation that convolution operations reduce the high-frequency sparsity of images, this paper proposes a novel adaptive frequency-domain enhancement regularization prior for blur kernel estimation (Adaptive Frequency-Domain Tuning for Sparse-Based Prior, AFTS). This prior effectively captures the degradation law of high-frequency features during image blurring through adaptive frequency-domain enhancement and a nonlinear activation mechanism. We embed the AFTS prior into the maximum a posteriori (MAP) estimation framework, construct a joint optimization model for sharp images and blur kernels, and adopt the half-quadratic splitting (HQS) and coordinate descent strategies to achieve efficient solutions. Experiments on multiple standard datasets demonstrate that the proposed method achieves performance comparable to state-of-the-art blind deblurring algorithms in objective metrics such as PSNR and SSIM, while exhibiting significant advantages in computational efficiency. It provides a feasible solution for high-efficiency image restoration in future applications.
| [1] | Al Radi, A.M., Majumder, P.S. and Khan, M.M. (2025) Blind Image Deblurring with FFT-ReLU Sparsity Prior. 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Tucson, 26 February-6 March 2025, 3447-3456. https://doi.org/10.1109/wacv61041.2025.00340 |
| [2] | Hazimeh, H., Mazumder, R. and Nonet, T. (2023) L0learn: A Scalable Package for Sparse Learning Using 10 Regularization. Journal of Machine Learning Research, 24, 1-8. |
| [3] | Zhang, Z.Y., Zheng, L.L., Piao, Y.J., Tao, S.P., et al. (2022) Blind Remote Sensing Image Deblurring Using Local Binary Pattern Prior. Remote Sensing, 14, Article 1276. https://doi.org/10.3390/rs14051276 |
| [4] | Bai, Y.C., Jia, H.Z., Jiang, M., Liu, X.M., et al. (2019) Single Image Blind Deblurring Using Multi-Scale Latent Structure Prior. IEEE Transactions on Circuits and Systems for Video Technology, 30, 2033-2045. https://doi.org/10.1109/tcsvt.2019.2919159 |
| [5] | Cao, S., Tan, W., Xing, K., He, H. and Jiang, J. (2018) Dark Channel Inspired Deblurring Method for Remote Sensing Image. Journal of Applied Remote Sensing, 12, Article 015012. https://doi.org/10.1117/1.jrs.12.015012 |
| [6] | Wang, M.W., Zhu, F.Z., Zhu, B. and Bai, Y.Y. (2019) An Improved Remote Sensing Image Blind Deblurring Algorithm. 2019 3rd International Conference on Electronic Information Technology and Computer Engineering (EITCE), Xiamen, 18-20 October 2019, 667-670. https://doi.org/10.1109/eitce47263.2019.9094971 |
| [7] | Lim, H., Yu, S., Park, K., Seo, D. and Paik, J. (2020) Texture-Aware Deblurring for Remote Sensing Images Using L0-Based Deblurring and L2-Based Fusion. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 13, 3094-3108. https://doi.org/10.1109/jstars.2020.2999961 |
| [8] | Song, T., Li, L., Wu, J., Dong, W. and Cheng, D. (2024) Quality-Aware Blind Image Motion Deblurring. Pattern Recognition, 153, Article 110568. https://doi.org/10.1016/j.patcog.2024.110568 |
| [9] | Chen, L., Fang, F., Wang, T. and Zhang, G. (2019) Blind Image Deblurring with Local Maximum Gradient Prior. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 15-20 June 2019, 1742-1750. https://doi.org/10.1109/cvpr.2019.00184 |
| [10] | Levin, A., Weiss, Y., Durand, F. and Freeman, W.T. (2011) Efficient Marginal Likelihood Optimization in Blind Deconvolution. CVPR 2011, Colorado Springs, 20-25 June 2011, 2657-2664. https://doi.org/10.1109/cvpr.2011.5995308 |
| [11] | Yan, Y., Ren, W., Guo, Y., Wang, R. and Cao, X. (2017) Image Deblurring via Extreme Channels Prior. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, 21-26 July 2017, 6978-6986. https://doi.org/10.1109/cvpr.2017.738 |
| [12] | Liu, J., Yan, M. and Zeng, T. (2021) Surface-Aware Blind Image Deblurring. IEEE Transactions on Pattern Analysis and Machine Intelligence, 43, 1041-1055. https://doi.org/10.1109/tpami.2019.2941472 |
| [13] | Wen, F., Ying, R., Liu, Y., Liu, P. and Truong, T. (2021) A Simple Local Minimal Intensity Prior and an Improved Algorithm for Blind Image Deblurring. IEEE Transactions on Circuits and Systems for Video Technology, 31, 2923-2937. https://doi.org/10.1109/tcsvt.2020.3034137 |
| [14] | Ge, X., Tan, J., Zhang, L., Liu, J. and Hu, D. (2022) Blind Image Deblurring with Gaussian Curvature of the Image Surface. Signal Processing: Image Communication, 100, Article 116531. https://doi.org/10.1016/j.image.2021.116531 |
| [15] | Chen, L., Fang, F., Zhang, J., Liu, J. and Zhang, G. (2020) OID: Outlier Identifying and Discarding in Blind Image Deblurring. In: Lecture Notes in Computer Science, Springer, 598-613. https://doi.org/10.1007/978-3-030-58595-2_36 |
| [16] | Köhler, R., Hirsch, M., Mohler, B., Schölkopf, B. and Harmeling, S. (2012) Recording and Playback of Camera Shake: Benchmarking Blind Deconvolution with a Real-World Database. In: Lecture Notes in Computer Science, Springer Berlin Heidelberg, 27-40. https://doi.org/10.1007/978-3-642-33786-4_3 |
| [17] | Levin, A., Weiss, Y., Durand, F. and Freeman, W.T. (2009) Understanding and Evaluating Blind Deconvolution Algorithms. 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, 20-25 June 2009, 1964-1971. https://doi.org/10.1109/cvprw.2009.5206815 |
| [18] | Pan, J.S., Hu, Z., Su, Z.X. and Yang, M.H. (2014) Deblurring Text Images via L0-Regularized Intensity and Gradient Prior. 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, 23-28 June 2014, 2901-2908. https://doi.org/10.1109/cvpr.2014.371 |
| [19] | Xu, L., Zheng, S.C. and Jia, J.Y. (2013) Unnatural 10 Sparse Representation for Natural Image Deblurring. Proceedings of the 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops, Portland, 23-28 June 2013, 51107-51114. |
| [20] | Xu, L., Tao, X. and Jia, J. (2014) Inverse Kernels for Fast Spatial Deconvolution. In: Lecture Notes in Computer Science, Springer International Publishing, 33-48. https://doi.org/10.1007/978-3-319-10602-1_3 |
| [21] | Cho, S. and Lee, S. (2009) Fast Motion Deblurring. ACM Transactions on Graphics, 28, Article 145. https://doi.org/10.1145/1618452.1618491 |
| [22] | Krishnan, D. and Fergus, R. (2009) Fast Image Deconvolution Using Hyper-Laplacian Priors. In: Bengio, Y., Schuurmans, D. and Lafferty, J.D., Eds., Proceedings of the 23rd International Conference on Neural Information Processing Systems, Curran Associates Inc., 1033-1041. |
| [23] | Shan, Q., Jia, J.Y. and Agarwala, A. (2008) High-Quality Motion Deblurring from a Single Image. ACM Transactions on Graphics, 27, 1-10. https://doi.org/10.1145/1360612.1360672 |
| [24] | Wang, Z., Bovik, A.C., Sheikh, H.R. and Simoncelli, E.P. (2004) Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Transactions on Image Processing, 13, 600-612. https://doi.org/10.1109/tip.2003.819861 |
| [25] | Pan, J., Sun, D., Pfister, H. and Yang, M. (2016) Blind Image Deblurring Using Dark Channel Prior. 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, 27-30 June 2016, 1628-1636. https://doi.org/10.1109/cvpr.2016.180 |
| [26] | Pan, L., Hartley, R., Liu, M. and Dai, Y. (2019). Phase-only Image Based Kernel Estimation for Single Image Blind Deblurring. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 15-20 June 2019, 6027-6036. https://doi.org/10.1109/cvpr.2019.00619 |
| [27] | Sun, L., Cho, S., Wang, J. and Hays, J. (2013) Edge-Based Blur Kernel Estimation Using Patch Priors. IEEE International Conference on Computational Photography (ICCP), Cambridge, 19-21 April 2013, 1-8. https://doi.org/10.1109/iccphot.2013.6528301 |