全部 标题 作者
关键词 摘要

OALib Journal期刊
ISSN: 2333-9721
费用:99美元

查看量下载量

相关文章

更多...

Building an AI-Integrated Braille Recognition Model for Blind Education: From Mechanical Devices to Personalized Learning Systems

DOI: 10.4236/wjet.2026.141001, PP. 1-13

Keywords: Braille Recognition, Assistive Technology, Artificial Intelligence in Education, Personalized Learning, Inclusive Education

Full-Text   Cite this paper   Add to My Lib

Abstract:

The context of inclusive education for blind people lacks suitable learning materials and traditional devices are difficult to expand, creating a need for a personalized technological solution. This study proposes and evaluates an AI-integrated Braille recognition and conversion model, designed in a three-layer architecture including terminals, AI engines, and learning management systems. At the device layer, Raspberry Pi 5 connects a camera placed near the paper surface with a choice of OV9281 or IMX708 sensors, displayed via a vibrating dot matrix and speakers. At the AI layer, the processing chain applies region of interest cropping, local contrast enhancement, noise reduction, adaptive thresholding, skew and distortion correction, then segmenting lines, words, characters, recognizing them using optical and deep learning models such as CRNN or DBNet (for optical character recognition), and mapping the results to a two-level intensity vibration rule, extended to shapes and twelve basic colors. In the learning management layer, interactive data is used for adaptive suggestions using lightweight algorithms such as nearest neighbor and LightGBM (for generating personalized learning suggestions). Experiments with 15 blind students in Da Nang show recognition accuracy greater than 90% on the basic character set, supporting text reading, basic math and geometric perception. The results confirm the feasibility of the integration direction and suggest prospects for wide deployment in inclusive education, while also suggesting development directions for data expansion, hardware optimization and assessment standardization.

References

[1]  Samia, P., Oyieke, K., Kigen, B. and Wamithi, S. (2022) Education for Children and Adolescents Living with Disabilities in Sub-Saharan Africa—The Gaps and Opportunities. Frontiers in Public Health, 10, Article 979351.
https://doi.org/10.3389/fpubh.2022.979351

[2]  Aversano, L., Bernardi, M.L., Cimitile, M. and Pecori, R. (2021) Deep Neural Networks Ensemble to Detect COVID-19 from CT Scans. Pattern Recognition, 120, Article ID: 108135.
https://doi.org/10.1016/j.patcog.2021.108135
[3]  Park, B., Im, S., Lee, H., Lee, Y.T., Nam, C., Hong, S., et al. (2023) Visual and Tactile Perception Techniques for Braille Recognition. Micro and Nano Systems Letters, 11, Article No. 23.
https://doi.org/10.1186/s40486-023-00191-w

[4]  Gao, Z., Chang, L., Ren, B., Han, J. and Li, J. (2024) Enhanced Braille Recognition Based on Piezoresistive and Piezoelectric Dual-Mode Tactile Sensors. Sensors and Actuators A: Physical, 366, Article ID: 115000.
https://doi.org/10.1016/j.sna.2023.115000

[5]  AlSalman, A., Gumaei, A., AlSalman, A. and Al-Hadhrami, S. (2021) A Deep Learning-Based Recognition Approach for the Conversion of Multilingual Braille Images. Computers, Materials & Continua, 67, 3847-3864.
https://doi.org/10.32604/cmc.2021.015614

[6]  Baumgärtner, C., Schwarz, T. and Stiefelhagen, R. (2020) Image-Based Recognition of Braille Using Neural Networks on Mobile Devices. In: Miesenberger, K., Manduchi, R., Covarrubias Rodriguez, M. and Peňáz, P., Eds., Computers Helping People with Special Needs, Springer, 346-353.
https://doi.org/10.1007/978-3-030-58796-3_41

[7]  Moram, V., Zahruddin, S. and Kumar, S. (2025) Multifunctional Assistive Smart Glasses for Visually Impaired. SN Computer Science, 6, Article No. 173.
https://doi.org/10.1007/s42979-025-03701-2

[8]  Kim, S., Kim, Y., Choi, D. and Shin, B. (2019) Frequency Based Tactile Rendering Method for Pin-Array Tactile Devices. Journal of Ambient Intelligence and Humanized Computing, 13, 1665-1672.
https://doi.org/10.1007/s12652-019-01408-w

[9]  Zhou, Z., Yang, Y. and Liu, H. (2022) A Braille Reading System Based on Electrotactile Display with Flexible Electrode Array. IEEE/CAA Journal of Automatica Sinica, 9, 735-737.
https://doi.org/10.1109/jas.2022.105476
[10]  Williamson, B. (2021) Meta-EdTech. Learning, Media and Technology, 46, 1-5.
https://doi.org/10.1080/17439884.2021.1876089
[11]  Mahajan, S. and Rani, R. (2021) Text Detection and Localization in Scene Images: A Broad Review. Artificial Intelligence Review, 54, 4317-4377.
https://doi.org/10.1007/s10462-021-10000-8
[12]  Smith, R. (2007) An Overview of the Tesseract OCR Engine. Ninth International Conference on Document Analysis and Recognition (ICDAR 2007), Curitiba, 23-26 September 2007, 629-633.
https://doi.org/10.1109/icdar.2007.4376991

[13]  Liao, M., Wan, Z., Yao, C., Chen, K. and Bai, X. (2020) Real-Time Scene Text Detection with Differentiable Binarization. Proceedings of the AAAI Conference on Artificial Intelligence, 34, 11474-11481.
https://doi.org/10.1609/aaai.v34i07.6812

[14]  Chen, T. and Liu, D. (2025) Machine Learning and Big Data on Raspberry Pi: A Performance Evaluation. Proceedings of the 23rd ACM Conference on Embedded Networked Sensor Systems, Irvine, 6-9 May 2025, 648-649.
https://doi.org/10.1145/3715014.3724051

[15]  Pizer, S.M., Amburn, E.P., Austin, J.D., Cromartie, R., Geselowitz, A., Greer, T., et al. (1987) Adaptive Histogram Equalization and Its Variations. Computer Vision, Graphics, and Image Processing, 39, 355-368.
https://doi.org/10.1016/s0734-189x(87)80186-x
[16]  Sauvola, J. and Pietikäinen, M. (2000) Adaptive Document Image Binarization. Pattern Recognition, 33, 225-236.
https://doi.org/10.1016/s0031-3203(99)00055-2

[17]  Shi, B., Bai, X. and Yao, C. (2017) An End-To-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39, 2298-2304.
https://doi.org/10.1109/tpami.2016.2646371

[18]  Zhou, X., Yao, C., Wen, H., Wang, Y., Zhou, S., He, W., et al. (2017) EAST: An Efficient and Accurate Scene Text Detector. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, 21-26 July 2017, 2642-2651.
https://doi.org/10.1109/cvpr.2017.283

[19]  Kuhail, M.A., Alturki, N., Alramlawi, S. and Alhejori, K. (2022) Interacting with Educational Chatbots: A Systematic Review. Education and Information Technologies, 28, 973-1018.
https://doi.org/10.1007/s10639-022-11177-3

[20]  Wang, C., Chang, L. and Liu, T. (2022) Predicting Student Performance in Online Learning Using a Highly Efficient Gradient Boosting Decision Tree. In: Shi, Z., Zucker, J.D. and An, B., Eds., Intelligent Information Processing XI, Springer, 508-521.
https://doi.org/10.1007/978-3-031-03948-5_41

[21]  Zawacki-Richter, O., Marín, V.I., Bond, M. and Gouverneur, F. (2019) Systematic Review of Research on Artificial Intelligence Applications in Higher Education—Where Are the Educators? International Journal of Educational Technology in Higher Education, 16, Article No. 39.
https://doi.org/10.1186/s41239-019-0171-0

[22]  Fetters, M.D., Curry, L.A. and Creswell, J.W. (2013) Achieving Integration in Mixed Methods Designs—Principles and Practices. Health Services Research, 48, 2134-2156.
https://doi.org/10.1111/1475-6773.12117

[23]  Bangor, A., Kortum, P.T. and Miller, J.T. (2008) An Empirical Evaluation of the System Usability Scale. International Journal of Human-Computer Interaction, 24, 574-594.
https://doi.org/10.1080/10447310802205776

[24]  Karatzas, D., Gomez-Bigorda, L., Nicolaou, A., Ghosh, S., Bagdanov, A., Iwamura, M., et al. (2015) ICDAR 2015 Competition on Robust Reading. 2015 13th International Conference on Document Analysis and Recognition (ICDAR), Tunis, 23-26 August 2015, 1156-1160.
https://doi.org/10.1109/icdar.2015.7333942

[25]  Otsu, N. (1979) A Threshold Selection Method from Gray-Level Histograms. IEEE Transactions on Systems, Man, and Cybernetics, 9, 62-66.
https://doi.org/10.1109/tsmc.1979.4310076

[26]  Croce, F. and Hein, M. (2019). Sparse and Imperceivable Adversarial Attacks. 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, 27 October-2 November 2019, 4723-4731.
https://doi.org/10.1109/iccv.2019.00482

[27]  Haga, Y., Makishi, W., Iwami, K., Totsu, K., Nakamura, K. and Esashi, M. (2005) Dynamic Braille Display Using SMA Coil Actuator and Magnetic Latch. Sensors and Actuators A: Physical, 119, 316-322.
https://doi.org/10.1016/j.sna.2004.10.001

[28]  Kim, M., Yoon, J., Lim, C. and Kang, S. (2025) The Development of Braille Display Utilizing Rotating Braille-Embossing Disks with Ai-Based Character Recognition. Journal of Mechanical Science and Technology, 39, 3483-3491.
https://doi.org/10.1007/s12206-025-0540-7
[29]  Sedrakyan, G., Malmberg, J., Verbert, K., Järvelä, S. and Kirschner, P.A. (2020) Linking Learning Behavior Analytics and Learning Science Concepts: Designing a Learning Analytics Dashboard for Feedback to Support Learning Regulation. Computers in Human Behavior, 107, Article ID: 105512.
https://doi.org/10.1016/j.chb.2018.05.004

[30]  Zhu, Y., Yao, C. and Bai, X. (2015) Scene Text Detection and Recognition: Recent Advances and Future Trends. Frontiers of Computer Science, 10, 19-36.
https://doi.org/10.1007/s11704-015-4488-0
[31]  Yang, W., Huang, J., Wang, R., Zhang, W., Liu, H. and Xiao, J. (2021) A Survey on Tactile Displays for Visually Impaired People. IEEE Transactions on Haptics, 14, 712-721.
https://doi.org/10.1109/toh.2021.3085915

[32]  Kaliisa, R., Misiejuk, K., López-Pernas, S., Khalil, M. and Saqr, M. (2024) Have Learning Analytics Dashboards Lived up to the Hype? A Systematic Review of Impact on Students’ Achievement, Motivation, Participation and Attitude. Proceedings of the 14th Learning Analytics and Knowledge Conference, Kyoto, 18-22 March 2024, 295-304.
https://doi.org/10.1145/3636555.3636884

Full-Text

Contact Us

service@oalib.com

QQ:3279437679

WhatsApp +8615387084133