|
|
基于评论约束与Kolmogorov-Arnold网络的深度推荐算法
|
Abstract:
基于深度学习的推荐算法逐渐成为推荐系统领域的主流研究方向。然而，大多数现有工作仅基于单一的用户与物品交互数据，并且缺乏可解释性。本文对用户评论进行充分挖掘，并且额外引入物品信息来缓解冷启动问题并提高推荐算法的准确性。该算法利用BERT预训练模型来处理文本数据，并将用户与物品的评论特征与矩阵分解得到的潜在特征相融合，最后在评分预测任务中使用Kolmogorov-Arnold网络进行特征学习。通过本文算法与其他基线算法在亚马逊评论数据集上进行对比，该算法与基线算法相比显著提高了评分预测的精度以及准确率和召回率。本研究通过深入挖掘用户评论文本和物品描述信息，证明其在提升推荐算法准确性方面的显著效果，为推荐系统的研究提供了新的思路。
Recommendation algorithms based on deep learning have emerged as a prominent research in the field of recommender systems. However, most existing approaches rely solely on user-item interaction data and lack interpretability. This article thoroughly explores user reviews and incorporates additional item information to alleviate the cold-start problem and enhance the accuracy of recommendation algorithms. The proposed approach employs the BERT pre-trained model to process textual data and integrates review-based features of users and items with latent features obtained through matrix factorization. Finally, the Kolmogorov-Arnold network is utilized for feature learning in the rating prediction task. Comparative experiments on Amazon review datasets demonstrate that the proposed algorithm significantly outperforms baseline methods in terms of rating prediction accuracy and recall. By deeply mining user review texts and item descriptions, this study validates their substantial impact on improving recommendation accuracy and offers new insights for recommender system research.
| [1] | Roy, D. and Dutta, M. (2022) A Systematic Review and Research Perspective on Recommender Systems. Journal of Big Data, 9, Article No. 59. https://doi.org/10.1186/s40537-022-00592-5 |
| [2] | Saifudin, I. and Widiyaningtyas, T. (2024) Systematic Literature Review on Recommender System: Approach, Problem, Evaluation Techniques, Datasets. IEEE Access, 12, 19827-19847. https://doi.org/10.1109/access.2024.3359274 |
| [3] | Raza, S. and Ding, C. (2021) News Recommender System: A Review of Recent Progress, Challenges, and Opportunities. Artificial Intelligence Review, 55, 749-800. https://doi.org/10.1007/s10462-021-10043-x |
| [4] | Ko, H., Lee, S., Park, Y. and Choi, A. (2022) A Survey of Recommendation Systems: Recommendation Models, Techniques, and Application Fields. Electronics, 11, Article 141. https://doi.org/10.3390/electronics11010141 |
| [5] | Papadakis, H., Papagrigoriou, A., Panagiotakis, C., Kosmas, E. and Fragopoulou, P. (2022) Collaborative Filtering Recommender Systems Taxonomy. Knowledge and Information Systems, 64, 35-74. https://doi.org/10.1007/s10115-021-01628-7 |
| [6] | Fkih, F. (2022) Similarity Measures for Collaborative Filtering-Based Recommender Systems: Review and Experimental Comparison. Journal of King Saud University—Computer and Information Sciences, 34, 7645-7669. https://doi.org/10.1016/j.jksuci.2021.09.014 |
| [7] | Jena, K.K., Bhoi, S.K., Malik, T.K., Sahoo, K.S., Jhanjhi, N.Z., Bhatia, S., et al. (2022) E-learning Course Recommender System Using Collaborative Filtering Models. Electronics, 12, Article 157. https://doi.org/10.3390/electronics12010157 |
| [8] | Isinkaye, F.O. (2021) Matrix Factorization in Recommender Systems: Algorithms, Applications, and Peculiar Challenges. IETE Journal of Research, 69, 6087-6100. https://doi.org/10.1080/03772063.2021.1997357 |
| [9] | Zhang, S., Yao, L., Sun, A., et al. (2019) Deep Learning Based Recommender System: A Survey and New Perspectives. ACM Computing Surveys (CSUR), 52, 1-38. |
| [10] | Papadakis, H., Papagrigoriou, A., Kosmas, E., Panagiotakis, C., Markaki, S. and Fragopoulou, P. (2023) Content-Based Recommender Systems Taxonomy. Foundations of Computing and Decision Sciences, 48, 211-241. https://doi.org/10.2478/fcds-2023-0009 |
| [11] | Liang, M. and Niu, T. (2022) Research on Text Classification Techniques Based on Improved TF-IDF Algorithm and LSTM Inputs. Procedia Computer Science, 208, 460-470. https://doi.org/10.1016/j.procs.2022.10.064 |
| [12] | Church, K.W. (2016) Word2Vec. Natural Language Engineering, 23, 155-162. https://doi.org/10.1017/s1351324916000334 |
| [13] | Tarus, J.K., Niu, Z. and Mustafa, G. (2017) Knowledge-Based Recommendation: A Review of Ontology-Based Recommender Systems for E-learning. Artificial Intelligence Review, 50, 21-48. https://doi.org/10.1007/s10462-017-9539-5 |
| [14] | Çano, E. and Morisio, M. (2017) Hybrid Recommender Systems: A Systematic Literature Review. Intelligent Data Analysis, 21, 1487-1524. https://doi.org/10.3233/ida-163209 |
| [15] | He, X., Liao, L., Zhang, H., Nie, L., Hu, X. and Chua, T. (2017) Neural Collaborative Filtering. Proceedings of the 26th International Conference on World Wide Web, Perth, 3-7 April 2017, 173-182. https://doi.org/10.1145/3038912.3052569 |
| [16] | Sharifani, K. and Amini, M. (2023) Machine Learning and Deep Learning: A Review of Methods and Applications. World Information Technology and Engineering Journal, 10, 3897-3904. |
| [17] | Li, C., Ishak, I., Ibrahim, H., et al. (2023) Deep Learning-Based Recommendation System: Systematic Review and Classification. IEEE Access, 11, 113790-113835. https://doi.org/10.1109/ACCESS.2023.3323353 |
| [18] | Yu, M., Quan, T., Peng, Q., Yu, X. and Liu, L. (2021) A Model-Based Collaborate Filtering Algorithm Based on Stacked Autoencoder. Neural Computing and Applications, 34, 2503-2511. https://doi.org/10.1007/s00521-021-05933-8 |
| [19] | Noulapeu Ngaffo, A. and Choukair, Z. (2022) A Deep Neural Network-Based Collaborative Filtering Using a Matrix Factorization with a Twofold Regularization. Neural Computing and Applications, 34, 6991-7003. https://doi.org/10.1007/s00521-021-06831-9 |
| [20] | Tegene, A., Liu, Q., Gan, Y., Dai, T., Leka, H. and Ayenew, M. (2023) Deep Learning and Embedding Based Latent Factor Model for Collaborative Recommender Systems. Applied Sciences, 13, Article 726. https://doi.org/10.3390/app13020726 |
| [21] | Zheng, L., Noroozi, V. and Yu, P.S. (2017) Joint Deep Modeling of Users and Items Using Reviews for Recommendation. Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, Cambridge, 6-10 February 2017, 425-434. https://doi.org/10.1145/3018661.3018665 |
| [22] | Chen, C., Zhang, M., Liu, Y. and Ma, S. (2018) Neural Attentional Rating Regression with Review-Level Explanations. Proceedings of the 2018 World Wide Web Conference on World Wide Web—WWW’18, Lyon, 23-27 April 2018, 1583-1592. https://doi.org/10.1145/3178876.3186070 |
| [23] | Chen, Z., Wang, X., Xie, X., Wu, T., Bu, G., Wang, Y., et al. (2019) Co-Attentive Multi-Task Learning for Explainable Recommendation. Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, Macao, 10-16 August 2019, 2137-2143. https://doi.org/10.24963/ijcai.2019/296 |
| [24] | Li, L., Zhang, Y. and Chen, L. (2021) Personalized Transformer for Explainable Recommendation. arXiv: 2105.11601. |
| [25] | Vaswani, A., Shazeer, N., Parmar, N., et al. (2017) Attention Is All You Need. arXiv: 1706.03762. |
| [26] | Devlin, J., Chang, M.W., Lee, K., et al. (2018) Bert: Pre-Training of Deep Bidirectional Transformers for Language Understanding. arXiv: 1810.04805. |
| [27] | Liu, Z., Wang, Y., Vaidya, S., et al. (2024) Kan: Kolmogorov-Arnold Networks. arXiv: 2404.19756. |
| [28] | Chin, W.S., Yuan, B.W., Yang, M.Y., et al. (2016) LIBMF: A Library for Parallel Matrix Factorization in Shared-Memory Systems. Journal of Machine Learning Research, 17, 1-5. |
| [29] | Safarov, F., Kutlimuratov, A., Abdusalomov, A.B., Nasimov, R. and Cho, Y. (2023) Deep Learning Recommendations of E-Education Based on Clustering and Sequence. Electronics, 12, Article 809. https://doi.org/10.3390/electronics12040809 |
| [30] | Jalili, M., Ahmadian, S., Izadi, M., Moradi, P. and Salehi, M. (2018) Evaluating Collaborative Filtering Recommender Algorithms: A Survey. IEEE Access, 6, 74003-74024. https://doi.org/10.1109/access.2018.2883742 |
| [31] | Su, Z., Huang, Z., Ai, J., Zhang, X., Shang, L. and Zhao, F. (2022) Enhancing the Scalability of Distance-Based Link Prediction Algorithms in Recommender Systems through Similarity Selection. PLOS ONE, 17, e0271891. https://doi.org/10.1371/journal.pone.0271891 |
