|
|
基于多标签随机游走的选择性集成方法用于表情识别
|
Abstract:
为了提升分类器集成的性能，本文提出了一种基于多标签随机游走的选择性集成方法，该方法将分类器选择问题建模为多标签分类问题，以灵活有效选择分类器。首先在训练集样本与分类器序列间建立映射，将能正确识别样本的分类器序列视为样本标签，对于一个特定的测试样本，寻找它的近邻样本，并构建出多标签随机游走图，执行随机游走过程，根据收敛后的概率向量选择出对应的分类器序列进行集成。在Fer2013、CK+和JAFFE人脸表情数据集上进行实验，并与一些当前先进的选择性集成算法进行对比，实验结果证明了该算法的可行性和有效性。
In order to improve the ensemble performance of classifier ensemble, a selective ensemble method based on multi-label random walk is proposed, which models the classifier selection problem as a multi-label classification problem to select classifiers flexibly and effectively. First, a mapping is established between the training set samples and the classifier sequence, and the classifier sequence that can correctly identify the sample is regarded as the sample label. For a specific test sample, its neighbor samples are found, and a multi-label random walk graph is constructed. A random walk process is performed, and the corresponding classifier sequence is selected for ensemble according to the converged probability vector. Experiments are carried out on Fer2013, CK+ and JAFFE facial expression datasets, and compared with some current advanced selective ensemble algorithms. The experimental results demonstrate the feasibility and effectiveness of the algorithm.
| [1] | 饶川, 苟先太, 金炜东. 基于选择性集成学习的高速列车故障识别研究[J]. 计算机应用研究, 2018, 35(5): 1365-1367. |
| [2] | Jan, Z. and Verma, B. (2019) A Novel Diversity Measure and Classifier Selection Approach for Generating Ensemble Classifiers. IEEE Access, 7, 156360-156373. https://doi.org/10.1109/ACCESS.2019.2949059 |
| [3] | Wang, Z.W., Wang, S.K., Wan, B.T., et al. (2020) A Novel Multi-Label Classification Algorithm Based on K-Nearest Neighbor and Random Walk. International Journal of Distributed Sensor Networks, 16, 1-17.
https://doi.org/10.1177/1550147720911892 |
| [4] | 郑伟, 王朝坤, 刘璋, 等. 一种基于随机游走模型的多标签分类算法[J]. 计算机学报, 2010, 33(8): 1418-1426. |
| [5] | Goodfellow, I.J., Erhan, D., Carrier, P.L., et al. (2015) Challenges in Representation Learning: A Report on Three Machine Learning Contests. Neural Networks, 64, 59-63. https://doi.org/10.1016/j.neunet.2014.09.005 |
| [6] | Lucey, P., Cohn, J.F., Kanade, T., et al. (2010) The Extended Cohn-Kanade Dataset (CK+): A Complete Dataset for Action Unit and Emotion-Specified Expression. 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, San Francisco, 13-18 June 2010, 94-101.
https://doi.org/10.1109/CVPRW.2010.5543262 |
| [7] | Lyons, M.J., Akamatsu, S., Kamachi, M.G., et al. (2002) Coding Facial Expressions with Gabor Wavelets. 3rd IEEE International Conference on Automatic Face and Gesture Recognition, Nara, 14-16 April 1998, 200-205. |
| [8] | Li, D.Y., Wen, G.H., Li, X., et al. (2019) Graph-Based Dynamic Ensemble Pruning for Facial Expression Recognition. Applied Intelligence, 49, 3188-3206. https://doi.org/10.1007/s10489-019-01435-2 |
| [9] | Krizhevsky, A., Sutskever, I. and Hinton, G.E. (2017) ImageNet Classification with Deep Convolutional Neural Networks. Communications of the ACM, 60, 84-90. https://doi.org/10.1145/3065386 |
| [10] | Ma, H. and Celik, T. (2019) FER-Net: Facial Expression Recognition Using Densely Connected Convolutional Network. Electronics Letters, 55, 184-186. https://doi.org/10.1049/el.2018.7871 |
| [11] | Dai, Q. and Han, X.M. (2016) An Efficient Ordering-Based Ensemble Pruning Algorithm via Dynamic Programming. Applied Intelligence, 44, 816-830. https://doi.org/10.1007/s10489-015-0729-z |
| [12] | Li, N., Yu, Y. and Zhou, Z.H. (2012) Diversity Regularized Ensemble Pruning, Machine Learning and Knowledge Discovery in Databases. Proceedings of the European Conference (ECML PKDD 2012), Bristol, 24-28 September 2012, 330-345. https://doi.org/10.1007/978-3-642-33460-3_27 |
| [13] | Kuncheva, L.I. (2013) A Bound on Kappa-Error Diagrams for Analysis of Classifier Ensemble. IEEE Transactions on Knowledge and Data Engineering, 25, 494-501. https://doi.org/10.1109/TKDE.2011.234 |
| [14] | Kuncheva, L.I. and Whitaker, C.J. (2003) Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy. Machine Learning, 51, 181-207. https://doi.org/10.1023/A:1022859003006 |
| [15] | Markatopoulou, F., Tsoumakas, G. and Vlahavas, I. (2014) Dynamic Ensemble Pruning Based on Multi-Label Classification. Neurocomputing, 150, 501-512. https://doi.org/10.1016/j.neucom.2014.07.063 |
| [16] | Albert, H.R., Ko, R.S., et al. (2008) From Dynamic Classifier Selection to Dynamic Ensemble Selection. Pattern Recognition, 41, 1718-1731. https://doi.org/10.1016/j.patcog.2007.10.015 |
| [17] | 周伟航, 肖正清, 钱育蓉, 等. 微表情自动分析方法研究综述[J]. 计算机应用研究, 2022, 39(7): 1921-1932. |
| [18] | Ge, H.L., Zhu, Z.Y., Dai, Y.W., et al. (2022) Facial Expression Recognition Based on Deep Learning. Computer Methods and Programs in Biomedicine, 215, Article ID: 106621. https://doi.org/10.1016/j.cmpb.2022.106621 |
| [19] | Li, D.Y., Wen, G.H., Hou, Z., et al. (2019) RTCRelief-F: An Effective Clustering and Ordering-Based Ensemble Pruning Algorithm for Facial Expression Recognition. Knowledge and Information Systems, 59, 219-250.
https://doi.org/10.1007/s10115-018-1176-z |
| [20] | Liang, Z.F., Wang, H., Yang, K.X., et al. (2022) Adaptive Fusion Based Method for Imbalanced Data Classification. Frontiers in Neurorobotics, 16, Article ID: 827913. https://doi.org/10.3389/fnbot.2022.827913 |
| [21] | Cruz, R., Sabourin, R. and Cavalcanti, G. (2018) Prototype Selection for Dynamic Classifier and Ensemble Selection. Neural Computing and Applications, 29, 447-457. https://doi.org/10.1007/s00521-016-2458-6 |
| [22] | Li, D.Y. and Wen, G.H. (2018) MRMR-Based Ensemble Pruning for Facial Expression Recognition. Multimedia Tools and Applications, 77, 15251-15272. https://doi.org/10.1007/s11042-017-5105-z |
| [23] | Hou, C., Xia, Y., Xu, Z., et al. (2016) Learning Classifier Competence Based on Graph for Dynamic Classifier Selection. 2016 12th International Conference on Natural Computation and 13th Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), Changsha, 13-15 August 2016, 1164-1168. https://doi.org/10.1109/FSKD.2016.7603343 |
| [24] | Zhang, C., Wu, Y. and Zhu, M. (2019) Pruning Variable Selection Ensembles. Statistical Analysis and Data Mining, 12, 168-184. https://doi.org/10.1002/sam.11410 |
| [25] | Elmi, J. and Eftekhari, M. (2021) Multi-Layer Selector (MLS): Dynamic Selection Based on Filtering Some Competence Measures. Applied Soft Computing, 104, Article ID: 107257. https://doi.org/10.1016/j.asoc.2021.107257 |
