Neural Networks (NN) are the functional unit of Deep Learning and are known to mimic the behavior of the human brain to solve complex data-driven problems. Whenever we train our own neural networks, we need to take care of something called the generalization of the neural network. The performance of Artificial Neural Networks (ANN) mostly depends upon its generalization capability. In this paper, we propose an innovative approach to enhance the generalization capability of artificial neural networks (ANN) using structural redundancy. A novel perspective on handling input data prototypes and their impact on the development of generalization, which could improve to ANN architectures accuracy and reliability is described.
References
[1]
Hendrycks, D. and Gimpel, K. (2017) A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks. Conference Track Proceedings. https://openreview.net/forum?id=Hkg4TI9xl
[2]
Zhuravlev, D.V. and Smolin, V.S. (2023) The Neural Network Revolution of Artificial Intelligence and It’s Development Options. Proceedings of the 6th International Conference “Futurity Designing. Digital Reality Problems”. https://doi.org/10.20948/future-2023-16
[3]
Vedyakhin, A., et al. (2021) Strong Artificial Intelligence: On the Approaches to Super-Intelligence. Intellectual Literature, 232.
[4]
Khaikin, S. (2006) Neural Networks: A Complete Course. 2nd Edition, Williams, 1104.
[5]
Zhang, C.Y., Bengio, S., Hardt, M., Recht, B. and Vinyals, O. (2017) Understanding Deep Learning Requires Rethinking Generalization. 5th International Conference on Learning Representations, Toulon, 24-26 April 2017. https://openreview.net/pdf?id=Sy8gdB9xx
[6]
Vincent, J. (2022) ChatGPT Proves AI Is Finally Mainstream and Things Are Only Going to Get Weirder. https://www.theverge.com/2022/12/8/23499728/aicapability-accessibility-chatgpt-stable-diffusion-commercialization
[7]
Rose, J. (2022) Inside Midjourney, the Generative Art AI That Rivals DALL-E. https://www.vice.com/en/article/wxn5wn/inside-midjourney-the-generativeart-ai-that-rivals-dall-e
[8]
Nazarov, A.V., Burlutsky, S.G. and Matasov, Yu.F. (2023) Neurometric Approach to Solving the Problem of Interpolation in Artificial Intelligence Systems Based on Machine Learning Technologies. Collection of Articles. Reports of the IV International Scientific Conference “Aerospace Instrumentation and Operational Technologies”, Part 2, St. Petersburg, 72-77.
[9]
Bose, A., Das, A., Dandi, Y. and Rai, P. (2021) NeurInt-Learning Interpolation by Neural ODE. Spotlight at the NeurIPS 2021 Workshop on the Symbiosis of Deep Learning and Differential Equations (DLDE).
[10]
Farago, A. and Lugosi, G. (n.d.) Strong Universal Consistency of Neural Network Classifiers. Proceedings. IEEE International Symposium on Information Theory, San Antonio, 17-22 January 1993, 431. https://doi.org/10.1109/isit.1993.748747
[11]
Rajput, D., Wang, W. and Chen, C. (2023) Evaluation of a Decided Sample Size in Machine Learning Applications. BMC Bioinformatics, 24, Article No. 48. https://doi.org/10.1186/s12859-023-05156-9
[12]
Balki, I., Amirabadi, A., Levman, J., Martel, A.L., Emersic, Z., Meden, B., et al. (2019) Sample-Size Determination Methodologies for Machine Learning in Medical Imaging Research: A Systematic Review. Canadian Association of Radiologists Journal, 70, 344-353. https://doi.org/10.1016/j.carj.2019.06.002
[13]
Leijnen, S. and Veen, F.V. (2020) The Neural Network Zoo. Proceedings, 47, Article No. 9. https://doi.org/10.3390/proceedings47010009
[14]
Rosenblatt, F. (1965) Principles of Neurodynamics. In: Perceptrons and the Theory of Brain Mechanisms, Mir, 480.
[15]
Vedenov, A.A. (1988) Modeling of Thinking Elements. Nauka, 158.
[16]
Wieland, А. and Leighton, R. (1987) Geometric Analysis of Neural Network Capabilities. 1st IEЕЕ International Conference on Neural Networks, San Diego, Vol. 3, 85-392.
