With the advancement of technology and the increase in user demands, gesture recognition played a pivotal role in the field of human-computer interaction. Among various sensing devices, Time-of-Flight (ToF) sensors were widely applied due to their low cost. This paper explored the implementation of a human hand posture recognition system using ToF sensors and residual neural networks. Firstly, this paper reviewed the typical applications of human hand recognition. Secondly, this paper designed a hand gesture recognition system using a ToF sensor VL53L5. Subsequently, data preprocessing was conducted, followed by training the constructed residual neural network. Then, the recognition results were analyzed, indicating that gesture recognition based on the residual neural network achieved an accuracy of 98.5% in a 5-class classification scenario. Finally, the paper discussed existing issues and future research directions.
References
[1]
Guo, L., Lu, Z.X. and Yao, L.G. (2021) Human-Machine Interaction Sensing Technology Based on Hand Gesture Recognition: A Review. IEEE Transactions on Human-Machine Systems, 51, 300-309. https://doi.org/10.1109/THMS.2021.3086003
[2]
Tripathi, R. and Verma, B. (2023) Survey on Vision-Based Dynamic Hand Gesture Recognition. The Visual Computer. https://doi.org/10.1007/s00371-023-03160-x
[3]
Das, A., Maitra, K., Roy, S., Ganguly, B., Sengupta, M. and Biswas, S. (2023) Development of a Real Time Vision-Based Hand Gesture Recognition System for Human-Computer Interaction. Proceedings of the 2023 IEEE 3rd Applied Signal Processing Conference (ASPCON), Haldia, 24-25 November 2023, 294-299. https://doi.org/10.1109/ASPCON59071.2023.10396583
[4]
Wang, Z.J., Liu, F., Li, X., Ma, M.J., Feng, X.X. and Guo, Y.J. (2023) A Survey of Hand Gesture Recognition Based on FMCW Radar. Proceedings of the 8th International Conference on Communication and Information Processing, Beijing, 3-5 November 2022, 73-79.
[5]
Wang, Y., Wang, S.-S., Tian, Z.-S., Zhou, M. and Wu, J.-J. (2019) Two-Stream Fusion Neural Network Approach for Hand Gesture Recognition Based on FMCW Radar. Acta Electronica Sinica, 47, 1408-1415.
[6]
Kai, Z.Q. and Shi, J.F. (2022) Modeling of Laser Femtosecond Gesture Recognition Algorithm and Implementation of Simple Navigation Microsystem. Computer Measurement and Control, 30, 246-254.
[7]
An, D., Xu, T.X., Zhang, Y.W. and Yue, Y. (2022) Hand Gesture Recognition Using ToF Camera and 3D Point Cloud Networks. ProceedingsFrontiers in Optics + Laser Science 2022(FIO, LS), Rochester, 17-20 October 2022, JW4B.56.
[8]
Wang, X.T., Feng, W.W., Shi, Z.G. and Wang, Y. (2023) Research on Dynamic Gesture Recognition with Low-Pixel ToF-Sensors. Proceedings of the 2023 International Conference on Ubiquitous Communication (Ucom), Xi’an, 7-9 July 2023, 150-155. https://doi.org/10.1109/Ucom59132.2023.10257656
[9]
Liu, W.B. and Liu, J. (2020) Overview of Vision-Based Dynamic Gesture Recognition. Computer Applications and Software, 37, 190-197.
[10]
Wong, W.K., Juwono, F.H. and Khoo, B.T.T. (2021) Multi-Features Capacitive Hand Gesture Recognition Sensor: A Machine Learning Approach. IEEE Sensors Journal, 21, 8441-8450. https://doi.org/10.1109/JSEN.2021.3049273
[11]
Moin, A., Zhou, A., Rahimi, A., Menon, A., Benatti, S., Alexandrov, G., et al. (2021) A Wearable Biosensing System with In-Sensor Adaptive Machine Learning for Hand Gesture Recognition. Nature Electronics, 4, 54-63. https://doi.org/10.1038/s41928-020-00510-8
[12]
Gong, S.F., Fang, Y.M., Shi, H.Y., Yan, X.Y. and Wu, Z.F. (2023) Experimental Teaching Design of Millimeter Wave Radar Gesture Recognition Based on Deep Learning. Experimental Technology and Management, 40, 168-176.
[13]
Sun, B.W. and Yu, F. (2021) Dynamic Gesture Recognition and Interaction of Monocular Camera Based on Deep Learning. Journal of Harbin University of Science and Technology, 26, 30-38.
[14]
Gong, A.J. (2024) Research on Building a Classification Diagnosis Model of Eye Diseases Based on ResNet Deep Neural Network. Journal of Medical Forum, 45, 379-383.
[15]
Peng, H., Deng, X.Z., Niu, Y.X. and Liu, Y. (2024) Application of ResNet50 Model in Recognition and Classification of Pneumonia. Journal ofFujian Computer, 40, 9-13.
[16]
Chen, W.J. and Zhang, Z. (2019) Hand Gesture Recognition Using sEMG Signals Based on Support Vector Machine. Proceedings of the 2019 IEEE 8th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), Chongqing, 24-26 May 2019, 230-234. https://doi.org/10.1109/ITAIC.2019.8785542
[17]
Xia, Z.Y., Zhou, C.L., Jie, J.Y., Zhou, T., Wang, X.F. and Xu, F. (2020) Micro-Motion Gesture Recognition Based on Multi-Channel Frequency Modulated Continuous Wave Millimeter Wave Radar. Journal of Electronics & Information Technology, 42, 164-172.
