|
|
融合网络社团特征与矩阵分解的推荐算法
|
Abstract:
为解决推荐系统在处理超大规模数据集时计算复杂度高、资源消耗大，以及推荐性能与可扩展性之间的矛盾，本文设计了一种融合用户相似性网络社团特征的快速并行梯度下降矩阵分解算法。首先，通过计算用户相似性，基于高相似度用户关系构建相似性网络，并采用模块度优化算法将用户划分为若干社团。同时，设计了一种用户补偿机制，在社团划分中引入指定数量的活跃用户，降低基于用户相似性社团划分的用户群内部数据的过度相似性。随后，针对每个用户群，采用并行梯度下降矩阵分解算法学习用户与物品的隐因子，以预测用户对未知物品的评分。该模型通过社团分组和并行计算，不仅减少了计算复杂度和资源消耗，还有效提升了推荐系统的准确性和算法学习效率。与现有领先算法相比，该模型在多个数据集上有效提高了推荐精度和召回率，降低了均方根误差和平均绝对误差。
To address the challenges of high computational complexity and resource consumption in recom- mendation systems when handling ultra-large datasets, this study proposes a fast parallel gradient descent matrix factorization algorithm that integrates user similarity network community features. First, by calculating user similarities, a similarity network is constructed based on highly similar user relationships, and a modularity optimization algorithm is employed to partition users into several communities. Additionally, a user compensation mechanism is designed to introduce a specified number of active users into the community division, thereby reducing the excessive similarity of data within user groups based on similarity community partitioning. Subsequently, for each user group, a parallel gradient descent matrix factorization algorithm is utilized to learn the latent factors of users and items, enabling the prediction of user ratings for unknown items. This model reduces computational complexity and resource consumption through community grouping and parallel computation, while effectively enhancing the accuracy of the recommendation system and the efficiency of algorithm learning. Compared to existing leading algorithms, this model significantly improves recommendation precision and recall across multiple datasets, while also lowering root mean square error and mean absolute error.
| [1] | Shi, X., He, Q., Luo, X., Bai, Y. and Shang, M. (2020) Large-Scale and Scalable Latent Factor Analysis via Distributed Alternative Stochastic Gradient Descent for Recommender Systems. IEEE Transactions on Big Data, 8, 420-431. https://doi.org/10.1109/tbdata.2020.2973141 |
| [2] | Khojamli, H. and Razmara, J. (2021) Survey of Similarity Functions on Neighborhood-Based Collaborative Filtering. Expert Systems with Applications, 185, Article ID: 115482. https://doi.org/10.1016/j.eswa.2021.115482 |
| [3] | Wei, W., Huang, C., Xia, L. and Zhang, C. (2023) Multi-Modal Self-Supervised Learning for Recommendation. Proceedings of the ACM Web Conference 2023, Austin, 30 April-4 May 2023, 790-800. https://doi.org/10.1145/3543507.3583206 |
| [4] | Ashokan, A. and Haas, C. (2021) Fairness Metrics and Bias Mitigation Strategies for Rating Predictions. Information Processing & Management, 58, Article ID: 102646. https://doi.org/10.1016/j.ipm.2021.102646 |
| [5] | Yu, R., Liu, Q., Ye, Y., Cheng, M., Chen, E. and Ma, J. (2020) Collaborative List-And-Pairwise Filtering from Implicit Feedback. IEEE Transactions on Knowledge and Data Engineering, 34, 2667-2680. https://doi.org/10.1109/tkde.2020.3016732 |
| [6] | Li, H., Li, K., An, J. and Li, K. (2022) An Online and Scalable Model for Generalized Sparse Nonnegative Matrix Factorization in Industrial Applications on Multi-GPU. IEEE Transactions on Industrial Informatics, 18, 437-447. https://doi.org/10.1109/tii.2019.2896634 |
| [7] | Shi, H., Sun, T., Li, S., et al. (2019) A Matrix Factorization Recommendation Algorithm with Time and Type Weight. Journal of Chongqing University, 42, 79-87. |
| [8] | Wu, Z., Zhou, Y., Wu, D., Chen, M. and Xu, Y. (2019) TAMF: Towards Personalized Time-Aware Recommendation for Over-the-Top Videos. Proceedings of the 29th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, Amherst, 21 June 2019, 43-48. https://doi.org/10.1145/3304112.3325606 |
| [9] | Guo, G., Yang, E., Shen, L., Yang, X. and He, X. (2019) Discrete Trust-Aware Matrix Factorization for Fast Recommendation. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, Macao, 10-16 August 2019, 1380-1386. https://doi.org/10.24963/ijcai.2019/191 |
| [10] | Lei, C., Dai, H., Yu, Z. and Li, R. (2020) A Service Recommendation Algorithm with the Transfer Learning Based Matrix Factorization to Improve Cloud Security. Information Sciences, 513, 98-111. https://doi.org/10.1016/j.ins.2019.10.004 |
| [11] | Jafri, S.I.H., Ghazali, R., Javid, I., Mahmood, Z. and Hassan, A.A.A. (2022) Deep Transfer Learning with Multimodal Embedding to Tackle Cold-Start and Sparsity Issues in Recommendation System. PLOS ONE, 17, e0273486. https://doi.org/10.1371/journal.pone.0273486 |
| [12] | Guo, R., Zhang, F., Wang, L., Zhang, W., Lei, X., Ranjan, R., et al. (2021) Bapa: A Novel Approach of Improving Load Balance in Parallel Matrix Factorization for Recommender Systems. IEEE Transactions on Computers, 70, 789-802. https://doi.org/10.1109/tc.2020.2997051 |
| [13] | Liu, X., Ho, C., Zheng, S. and Yuan, S. (2019) Comprehensive Evaluation of Large-Scale Parallel Matrix Factorization Algorithms. 2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS), Zhangjiajie, 10-12 August 2019, 811-818. https://doi.org/10.1109/hpcc/smartcity/dss.2019.00119 |
| [14] | Chin, W., Zhuang, Y., Juan, Y. and Lin, C. (2015) A Fast Parallel Stochastic Gradient Method for Matrix Factorization in Shared Memory Systems. ACM Transactions on Intelligent Systems and Technology, 6, 1-24. https://doi.org/10.1145/2668133 |
| [15] | Yu, H., Hsieh, C., Si, S. and Dhillon, I. (2012) Scalable Coordinate Descent Approaches to Parallel Matrix Factorization for Recommender Systems. 2012 IEEE 12th International Conference on Data Mining, Brussels, 10-13 December 2012, 765-774. https://doi.org/10.1109/icdm.2012.168 |
| [16] | Lee, H. and Kim, Y. (2020) Stochastic Gradient Descent for Matrix Completion: Hybrid Parallelization. Concurrency and Computation: Practice and Experience, 32, e5662. |
| [17] | Li, Q., Xiong, D. and Shang, M. (2022) Adjusted Stochastic Gradient Descent for Latent Factor Analysis. Information Sciences, 588, 196-213. https://doi.org/10.1016/j.ins.2021.12.065 |
| [18] | Chen, J. and Wang, L. (2020) Parallel Fractional Stochastic Gradient Descent with Adaptive Learning. IEEE Transactions on Neural Networks and Learning Systems, 31, 4053-4065. |
| [19] | Liu, Y., Wang, S,. Li, X., et al. (2024) A Meta-Adversarial Framework for Cross-Domain Cold-Start Recommendation. Data Science and Engineering, 9, 238-249. |
| [20] | Zhang, C., Yang, Y., Zhou, W. and Zhang, S. (2022) Distributed Bayesian Matrix Decomposition for Big Data Mining and Clustering. IEEE Transactions on Knowledge and Data Engineering, 34, 3701-3713. https://doi.org/10.1109/tkde.2020.3029582 |
| [21] | Hansel, A.C., Adrianus, Pradana, L., Suganda, A., Girsang, and Nugroho, A. (2022) Optimized LightGCN for Music Recommendation Satisfaction. 2022 6th International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE), Yogyakarta, 13-14 December 2022, 449-454. https://doi.org/10.1109/icitisee57756.2022.10057831 |
| [22] | Wu, J., Wang, X., Feng, F., He, X., Chen, L., Lian, J., et al. (2021) Self-Supervised Graph Learning for Recommendation. Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, 11-15 July 2021, 726-735. https://doi.org/10.1145/3404835.3462862 |
| [23] | 甘宏. 基于异质信息网络与图注意力的深度学习推荐算法研究[J]. 江西科学, 2023, 41(4): 788-793. |
| [24] | Su, Z., Lin, Z., Ai, J. and Li, H. (2021) Rating Prediction in Recommender Systems Based on User Behavior Probability and Complex Network Modeling. IEEE Access, 9, 30739-30749. https://doi.org/10.1109/access.2021.3060016 |
| [25] | Newman, M.E.J. (2004) Fast Algorithm for Detecting Community Structure in Networks. Physical Review E, 69, Article ID: 066133. https://doi.org/10.1103/physreve.69.066133 |
| [26] | Blondel, V., Guillaume, J.L. and Lambiotte, R. (2023) Fast Unfolding of Communities in Large Networks: 15 Years Later. arXiv:2311.06047. https://arxiv.org/abs/2311.06047 |
| [27] | 柯建坤, 许忠好. Louvain算法与K均值聚类算法的比较研究[J].应用概率统计, 2022, 38(5): 780-790. |
| [28] | Xu, S., Zhuang, H., Sun, F., Wang, S., Wu, T. and Dong, J. (2021) Recommendation Algorithm of Probabilistic Matrix Factorization Based on Directed Trust. Computers & Electrical Engineering, 93, Article ID: 107206. https://doi.org/10.1016/j.compeleceng.2021.107206 |
