|
|
基于核相似性的模糊多核最小二乘支持向量机
|
Abstract:
最小二乘支持向量机(Least Squares Support Vector Machine, LSSVM)由于同等对待所有样例，从而易受噪声干扰，影响分类性能。模糊LSSVM的提出一定程度上克服了以上问题。本文给出了一种新的样例隶属度计算方法，其在特征空间中，利用每一样例与其他样例核相似性获得隶属度，并将其应用于模糊多核LSSVM (Fuzzy Multi-Kernel LSSVM, FMK-LSSVM)，得到具有强鲁棒性的基于核相似性的模糊多核LSSVM。实验结果验证该方法的可行性与有效性。
Least squares support vector machine (LSSVM) is vulnerable to noise and affects the classification performance because it treats all samples equally. Fuzzy LSSVM overcomes the above problems by introducing membership. In this paper, we develop a new method to compute membership. In the feature space, the membership degree is obtained by using the kernel similarity between each sample and other samples, and applied to fuzzy multi-kernel LSSVM (FMK-LSSVM) to obtain a strong robust FMK-LSSVM. Experimental results verify the feasibility and effectiveness of this method.
| [1] | Cortes, C. and Vapnik, V. (1995) Support-Vector Networks. Machine Learning, 20, 273-297.
https://doi.org/10.1007/BF00994018 |
| [2] | Vapnik, V. (1998) Statistical Learning Theory. Wiley, New York. |
| [3] | Suykens, J.A.K. and Vandewalle, J. (1999) Least Squares Support Vector Machine Classifiers. Neural Pro-cessing Letters, 9, 293-300. https://doi.org/10.1023/A:1018628609742 |
| [4] | Zhao, Y.G., Song, Z., Zheng, F. and Shao, L. (2018) Learning a Multiple Kernel Similarity Metric for Kinship Verification. Information Sciences, 430-431, 247-260. https://doi.org/10.1016/j.ins.2017.11.048 |
| [5] | Mehmet, G. and Ethem, A. (2011) Multiple Kernel Learn-ing Algorithms. Journal of Machine Learning Research, 12, 2211-2268. |
| [6] | Wang, T., Lu, J. and Zhang, G. (2018) Two-Stage Fuzzy Multiple Kernel Learning Based on Hilbert-Schmidt Independence Criterion. IEEE Transactions on Fuzzy Systems, 26, 3703-3714.
https://doi.org/10.1109/TFUZZ.2018.2848224 |
| [7] | Wang, Z., Zhu, Z. and Li, D. (2020) Collaborative and Geo-metric Multi-Kernel Learning for Multi-Class Classification. Pattern Recognition, 99, 107050. https://doi.org/10.1016/j.patcog.2019.107050 |
| [8] | Gautam, C. and Tiwari, A. (2018) Localized Multiple Kernel Support Vector Data Description. 2018 IEEE International Conference on Data Mining Workshops (ICDMW), Singa-pore, 17-20 November 2018, 1514-1521.
https://doi.org/10.1109/ICDMW.2018.00224 |
| [9] | Lin, C. and Wang, S. (2002) Fuzzy Support Vector Machines. IEEE Transactions on Neural Networks, 13, 464-471. https://doi.org/10.1109/72.991432 |
| [10] | Song, F.F. and He, Q. (2021) Kernel-Target Alignment based Fuzzy Multi-Kernel Least Squares Support Vector Machine. International Journal of Intelligent Information and Management Science, 10, 113-119. |
| [11] | Huang, H.P. and Liu, Y.H. (2001) Fuzzy Support Vector Machines for Pattern Recognition and Data Mining. International Journal of Fuzzy Systems, 4, 826-835. |
| [12] | Liu, S.Y. and Du, Z.U. (2007) An Improved Fuzzy Support Vector Machine Method. CAAI Transactions on Intelligent Systems, 2, 30-33. |
| [13] | 曾山, 同小军, 桑农, 等. 基于对应分析的冗余模糊C均值聚类算法研究. 华中科技大学学报(自然科学版), 2012(40), 107-111. |
| [14] | He, Q. and Wu, C.X. (2011) Membership Evaluation and Feature Selection for Fuzzy Support Vector Machine Based on Fuzzy Rough Sets. Soft Computing, 15, 1105-1114. https://doi.org/10.1007/s00500-010-0577-z |
| [15] | De Diego, I.M., Mu？oz, A. and Moguerza, J.M. (2010) Methods for the Combination of Kernel Matrices within a Support Vector Framework. Machine Learning, 78, Article No. 137. https://doi.org/10.1007/s10994-009-5135-5 |
| [16] | Wang, T.H., Zhao, D.Y. and Tian, S.F. (2015) An Overview of Kernel Alignment and Its Applications. Artificial Intelligence Review, 43, 179-192. https://doi.org/10.1007/s10462-012-9369-4 |
| [17] | Cortes, C., Mohri, M. and Rostamizadeh, A. (2012) Algorithms for Learning Kernels Based on Centered Alignment. Journal of Machine Learning Research, 13, 795-828. |
| [18] | Wang, T., Qiu, Y. and Hua, J. (2020) Centered Kernel Alignment Inspired Fuzzy Support Vector Machine. Fuzzy Sets and Sys-tems, 394, 110-123. https://doi.org/10.1016/j.fss.2019.09.017 |
| [19] | He, Q., Zhang, Q.S., Wang, H.Y. and Zhang, C.L. (2020) Local Similarity Based Fuzzy Multiple Kernel One-Class Support Vector Machine. Complexity, 2020, Article ID: 8853277. https://doi.org/10.1155/2020/8853277 |
| [20] | 周志华. 机器学习[M]. 北京: 清华大学出版社, 2016. |
