|
机器学习在医学专业教育教学评价中应用的范围综述
|
Abstract:
目的:对在医学专业教育教学评价体系中应用机器学习的相关研究进行范围综述,为医学专业教育教学评估体系发展提供新思路。方法:依据范围综述的方法框架,确立研究问题,系统检索中国知网、万方、维普、PubMed、Web of Science 5个中英文库,检索时间为建库至2022年3月15日。筛选符合纳入标准的文献,并对文献进行分析讨论。结果:共检索文献301篇,纳入文献15篇。总结显示,机器学习主要应用在学生能力评价、课程反馈信息处理、预测和识别高危学生等方面。应用机器学习形成的教育教学评价模型评价效果较好,其在提高评价效率、节约评价成本、构建科学的评价指标等方面具有较大优势。结论:目前将机器学习应用于医学专业教育教学评价的研究较少,现有研究验证了机器学习在医学教育教学评价中应用的可行性,但其准确性、泛化性和有效性等方面仍待进一步完善。
Objective: To review the research on the application of machine learning in the evaluation system of medical professional education and teaching, and to provide new ideas for the development of medical professional education and teaching system. Methods: According to the method framework of scope review, the research questions were identified and the five Chinese and English databases of CNKI, Wanfang, VIP, PubMed and Web of Science were searched systematically from the establishment of the database to March 15, 2022. The literatures that met the inclusion criteria were screened and analyzed. Results: A total of 301 papers were retrieved, 15 of which were included according to the inclusion criteria. Machine learning methods are mainly applied in evaluating students’ abilities, processing course feedback information, predicting and identifying high-risk students, and so on. The results show that the evaluation effect of machine learning is better, and it has great advantages in improving evaluation efficiency, saving evaluation cost and constructing scientific evaluation indexes. Conclusion: Currently, there are few researches on the application of machine learning in the evaluation of medical education and teaching. Existing researches have verified the feasibility of the application of machine learning in the evaluation of medical education and teaching, but its accuracy, generalization and effectiveness still need to be further improved.
[1] | 何锡涛. 构建本科教育教学质量评价体系的设想[J]. 上海电机学院学报, 2005, 8(4): 25-27+35.
https://doi.org/10.3969/j.issn.2095-0020.2005.04.007 |
[2] | 朱雪波, 吕帆, 刘燕楠. 健康中国目标与医学教育改革[J]. 医学与哲学, 2019, 40(13): 64-67.
https://doi.org/10.12014/j.issn.1002-0772.2019.13.15 |
[3] | 胡延雪. 基于机器学习的教学评价模型的研究与实现[D]: [硕士学位论文]. 吉林: 延边大学, 2019. |
[4] | 李昊朋. 基于机器学习方法的智能机器人探究[J]. 通讯世界, 2019, 26(4): 241-242.
https://doi.org/10.3969/j.issn.1006-4222.2019.04.157 |
[5] | Davis, K., Drey, N. and Gould, D. (2009) What Are Scoping Studies? A Review of the Nursing Literature. International Journal of Nursing Studies, 46, 1386-1400. https://doi.org/10.1016/j.ijnurstu.2009.02.010 |
[6] | 朴杰, 李勇, 杨琳丽, 赵士斌. 运用机器学习法构建临床能力评价系统的研究[J]. 中国高等医学教育, 2013(3): 103-104+137. |
[7] | 张俊飞. 基于改进朴素贝叶斯算法实现评教评语情感分析[J]. 现代计算机, 2018(32): 3-6.
https://doi.org/10.3969/j.issn.1007-1423.2018.32.001 |
[8] | Chen, Y., Wrenn, J., Xu, H., Spickard, A., Habermann, R., Powers, J., et al. (2014) Automated Assessment of Medical Students’ Clinical Exposures According to AAMC Geri-atric Competencies. AMIA Annual Symposium Proceedings, 2014, 375-384. |
[9] | Yang, J., Zhang, G., Huang, R., Yan, P., Hu, P., Huang, L., et al. (2020) Nomograms Predicting Self-Regulated Learning Levels in Chinese Undergraduate Medical Students. Frontiers in Psychology, 10, Article No. 2858.
https://doi.org/10.3389/fpsyg.2019.02858 |
[10] | Hannaford, L., Cheng, X. and Kunes-Connell, M. (2021) Predict-ing Nursing Baccalaureate Program Graduates Using Machine Learning Models: A Quantitative Research Study. Nurse Education Today, 99, Article ID: 104784.
https://doi.org/10.1016/j.nedt.2021.104784 |
[11] | Holden, M.S., Xia, S., Lia, H., Keri, Z., Bell, C., Patterson, L., et al. (2019) Machine Learning Methods for Automated Technical Skills Assessment with Instructional Feedback in Ultra-sound-Guided Interventions. International Journal of Computer Assisted Radiology and Surgery, 14, 1993-2003. https://doi.org/10.1007/s11548-019-01977-3 |
[12] | Latifi, S., Gierl, M.J., Boulais, A.P. and De Champlain, A.F. (2016) Using Automated Scoring to Evaluate Written Responses in English and French on a High-Stakes Clinical Com-petency Examination. Evaluation & the Health Professions, 39, 100-113. https://doi.org/10.1177/0163278715605358 |
[13] | Borakati, A. (2021) Evaluation of an International Medical E-Learning Course with Natural Language Processing and Machine Learning. BMC Medical Education, 21, Article No. 181. https://doi.org/10.1186/s12909-021-02609-8 |
[14] | Mirchi, N., Bissonnette, V., Yilmaz, R., Ledwos, N., Win-kler-Schwartz, A. and Del Maestro, R.F. (2020) The Virtual Operative Assistant: An Explainable Artificial Intelligence Tool for Simulation-Based Training in Surgery and Medicine. PLOS ONE, 15, Article ID: e0229596. https://doi.org/10.1371/journal.pone.0229596 |
[15] | Bertolini, R., Finch, S.J. and Nehm, R.H. (2021) Testing the Impact of Novel Assessment Sources and Machine Learning Methods on Predictive Outcome Modeling in Undergradu-ate Biology. Journal of Science Education and Technology, 30, 193-209. https://doi.org/10.1007/s10956-020-09888-8 |
[16] | Zhao, S., Zhang, X., Jin, F. and Hahn, J. (2021) An Auxiliary Tasks Based Framework for Automated Medical Skill Assessment with Limited Data. 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society, Mexico, 1-5 November 2021, 1613-1617. https://doi.org/10.1109/EMBC46164.2021.9630498 |
[17] | Moglia, A., Morelli, L., D’Ischia, R., Fatucchi, L.M., Pucci, V., Berchiolli, R., et al. (2022) Ensemble Deep Learning for the Prediction of Proficiency at a Virtual Simulator for Robot-Assisted Surgery. Surgical Endoscopy, 1-7.
https://doi.org/10.1007/s00464-021-08999-6 |
[18] | Baloul, M.S., Yeh, J.H., Mukhtar, F., Traynor Jr., M.D., Shaikh, N., Rivera, M., et al. (2020) Video Commentary & Machine Learning: Tell Me What You See, I Tell You Who You Are. Journal of Surgical Education, In Press.
https://doi.org/10.1016/j.jsurg.2020.09.022 |
[19] | Ygm, A., Ukea, B., Xia, B., Schwaitzberg, S. and De, S. (2020) A Machine Learning Approach to Predict Surgical Learning Curves. Surgery, 167, 321-327. https://doi.org/10.1016/j.surg.2019.10.008 |
[20] | Oquendo, Y.A., Riddle, E.W., Hiller, D., Blinman, T.A. and Ku-chenbecker, K.J. (2018) Automatically Rating Trainee Skill at a Pediatric Laparoscopic Suturing Task. Surgical Endos-copy, 32, 1840-1857.
https://doi.org/10.1007/s00464-017-5873-6 |
[21] | 郑志高, 张立国, 张春荣. xMOOC的学习评价方法调查研究[J]. 中国电化教育, 2014(11): 44-49. |