All Title Author
Keywords Abstract

Publish in OALib Journal
ISSN: 2333-9721
APC: Only $99


Relative Articles


On the Matrices of Pairwise Frequencies of Categorical Attributes for Objects Classification

DOI: 10.4236/jilsa.2019.114004, PP. 65-75

Keywords: Categorical Attributes, Classification Algorithms, Invariants of Matrix Data, Data Processing

Full-Text   Cite this paper   Add to My Lib


This paper proposes two new algorithms for classifying objects with categorical attributes. These algorithms are derived from the assumption that the attributes of different object classes have different probability distributions. One algorithm classifies objects based on the distribution of the attribute frequencies, and the other classifies objects based on the distribution of the pairwise attribute frequencies described using a matrix of pairwise frequencies. Both algorithms are based on the method of invariants, which offers the simplest dependencies for estimating the probabilities of objects in each class by an average frequency of their attributes. The estimated object class corresponds to the maximum probability. This method reflects the sensory process models of animals and is aimed at recognizing an object class by searching for a prototype in information accumulated in the brain. Because these matrices may be sparse, the solution cannot be determined for some objects. For these objects, an analog of the k-nearest neighbors method is provided in which for each attribute value, the class to which the majority of the k-nearest objects in the training sample belong is determined, and the most likely class value is calculated. The efficiencies of these two algorithms were confirmed on five databases.


[1]  Bishop, C. (2006) Pattern Recognition and Machine Learning. Springer, Berlin, 738.
[2]  Hastie, T., Tibshirani, R. and Friedman, J. (2009) The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd Edition, Springer, Berlin, 764.
[3]  Murphy, K. (2012) Machine Learning. A Probabilistic Perspective. MIT Press, Cambridge, Massachusetts, London, 1098.
[4]  Shats, V.N. (2017) Classification Based on Invariants of the Data Matrix. Journal of Intelligent Learning Systems and Applications, 9, 35-46.
[6]  Shats, V.N. (2018) The Classification of Objects Based on a Model of Perception. Studies in Computational Intelligence, 736, 125-131.
[7]  Zadeh, L. (1979) Fuzzy Sets and Information Granularity. In: Gupta, N., Ragade, R. and Yager, R., Eds., Advances in Fuzzy Set Theory and Applications, World Science Publishing, Amsterdam, 3-18.
[8]  Hogg, R.V., Tanis, E.A. and Zimmerman, D. (2015) Probability and Statistical Inference. 9th Edition, Pearson, London, 557.
[9]  Asuncion, A. and Newman, D.J. (2007) UCI Machine Learning Repository. Irvine University of California, Irvine.


comments powered by Disqus

Contact Us


WhatsApp +8615387084133

WeChat 1538708413