This paper mainly studies the problem of tensor robust principal component analysis (TRPCA), in order to accurately recover the low rank and sparse components from the observed signals. Most of the existing robust principal component analysis (RPCA) methods are based on nuclear norm minimizationss. These methods minimize all singular values at the same time, so they can not approach the rank well in practice. In this paper, the idea of truncated nuclear norm regularization is extended to RPCA. At the same time, in order to improve the stability of the model, the tensor truncated Frobenius norm is newly defined. Truncated nuclear norm and truncated Frobenius norm are considered at the same time called hybrid truncated model of tensor. This method minimizes min singular values. In addition, this paper also gives an effective method to determine the contraction operator, and develops an effective iterative algorithm based on alternating direction to solve this optimization problem. Experimental results show the effectiveness and accuracy of this method.
Cite this paper
Luan, Y. and Jiang, W. (2022). Tensor Robust Principal Component Analysis via Hybrid Truncation Norm. Open Access Library Journal, 9, e9412. doi: http://dx.doi.org/10.4236/oalib.1109412.
De Lathauwer, L. and Vandewalle, J. (2004) Dimensionality Reduction in Higher-Order Signal Processing and Rank-(R1, R2, …, RN) Reduction in Multilinear Algebra. Linear Algebra and Its Applications, 391, 31-55.
https://doi.org/10.1016/j.laa.2004.01.016
Vasilescu, M. and Terzopoulos, D. (2003) Multilinear Subspace Analysis of Image Ensembles. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Madison, 18-20 June 2003, II-93.
Cyganek, B. (2015) Visual Pattern Recognition Framework Based on the Best Rank Tensor Decomposition. In: Tavares, J.M.R.S. and Jorge, R.N., Eds., Developments in Medical Image Processing and Computational Vision, Springer International Publishing, Berlin, 89-103.
Wright, J., Ganesh, A., Rao, S., et al. (2009) Robust Principal Component Analysis: Exact Recovery of Corrupted Low-Rank Matrices via Convex Optimization. 23rd Annual Conference on Neural Information Processing Systems 2009, Vancouver, 7-10 December 2009.
Javed, S., Mahmood, A., Bouwmans, T., et al. (2017) Motion-Aware Graph Regularized RPCA for Background Modeling of Complex Scenes. 2016 IEEE 23rd International Conference on Pattern Recognition (ICPR), Cancun, 4-8 December 2016, 120-125. https://doi.org/10.1109/ICPR.2016.7899619
Golbabaee, M. and Vandergheynst, P. (2012) Compressed Sensing of Simultaneous Low-Rank and Joint-Sparse Matrices. https://doi.org/10.1109/ICASSP.2012.6288484
Gandy, S., Recht, B. and Yamada, I. (2011) Tensor Completion and Lown-Rank Tensor Recovery via Convex Optimization. Inverse Problems, 27, Article ID: 025010.
https://doi.org/10.1088/0266-5611/27/2/025010
Kilmer, M.E., Braman, K., Hao, N., et al. (2013) Third-Order Tensors as Operators on Matrices: A Theoretical and Computational Framework with Applications in Imaging. SIAM Journal on Matrix Analysis and Applications, 34, 148-172.
https://doi.org/10.1137/110837711
Kilmer, M.E., et al. (2011) Factorization Strategies for Third-Order Tensors. Linear Algebra and Its Applications, 435, 641-658. https://doi.org/10.1016/j.laa.2010.09.020
Wang, A., Zhong, J. and Li, X. (2018) Coherent Low-Tubal-Rank Tensor Completion. 2017 4th IAPR Asian Conference on Pattern Recognition (ACPR), Nanjing, 26-29 November 2017, 518-523. https://doi.org/10.1109/ACPR.2017.66
Lu, C., Feng, J., Chen, Y., et al. (2020) Tensor Robust Principal Component Analysis with a New Tensor Nuclear Norm. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 925-938. https://doi.org/10.1109/TPAMI.2019.2891760
Lu, C., Feng, J., Chen, Y., et al. (2020) Tensor Robust Principal Component Analysis with a New Tensor Nuclear Norm. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 925-938. https://doi.org/10.1109/TPAMI.2019.2891760
Jiang, T.X., Huang, T.Z., Zhao, X.L., et al. (2017) Multi-Dimensional Imaging Data Recovery via Minimizing the Partial Sum of Tubal Nuclear Norm. Journal of Computational and Applied Mathematics, 372, Article ID: 112680.
Ye, H., Li, H., et al. (2019) A Hybrid Truncated Norm Regularization Method for Matrix Completion. IEEE Transactions on Image Processing, 28, 5171-5186.
Lu, C., Peng, X. and Wei, Y. (2019) Low-Rank Tensor Completion with a New Tensor Nuclear Norm Induced by Invertible Linear Transforms. 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, 15-20 June 2019, 5989-5997. https://doi.org/10.1109/CVPR.2019.00615
Lu, C., Feng, J., Lin, Z. and Yan, S. (2018) Exact Low Tubal Rank Tensor Recovery from Gaussian Measurements. Proceedings of the 27th International Joint Conference on Artificial Intelligence, Stockholm, 13-19 July 2018, 2504-2510.
https://doi.org/10.24963/ijcai.2018/347
He, B.S., Yang, H. and Wang, S.L. (2000) Alternating Direction Method with Self-Adaptive Penalty Parameters for Monotone Variational Inequalities. Journal of Optimization Theory and Applications, 106, 337-356.
https://doi.org/10.1023/A:1004603514434
Yang, J. and Yuan, X. (2012) Linearized Augmented Lagrangian and Alternating Direction Methods for Nuclear Norm Minimization. Mathematics of Computation, 82, 301-329. https://doi.org/10.1090/S0025-5718-2012-02598-1
Lin, Z., Liu, R. and Li, H. (2015) Linearized Alternating Direction Method with Parallel Splitting and Adaptive Penalty for Separable Convex Programs in Machine Learning. JMLR: Workshop and Conference Proceedings, Vol. 29, 116-132.
https://doi.org/10.1007/s10994-014-5469-5
Fan, H., Kuang, G. and Qiao, L. (2017) Fast Tensor Principal Component Analysis via Proximal Alternating Direction Method with Vectorized Technique. Applied Mathematics, 8, 77-86. https://doi.org/10.4236/am.2017.81007
Hu, Y., et al. (2013) Fast and Accurate Matrix Completion via Truncated Nuclear Norm Regularization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35, 2117-2130. https://doi.org/10.1109/TPAMI.2012.271
