人工智能人脸识别技术在实时评估医学生课堂专注度中的应用研究

doi:10.3760/cma.j.cn115259-20220516-00628

中华医学教育杂志 ›› 2023, Vol. 43 ›› Issue (1): 31-34.DOI: 10.3760/cma.j.cn115259-20220516-00628

人工智能人脸识别技术在实时评估医学生课堂专注度中的应用研究

杨静文¹, 杨宗瀚², 李健¹, 刘云松¹

¹北京大学口腔医学院·口腔医院,修复科国家口腔医学中心国家口腔疾病临床医学研究中心口腔生物材料和数字诊疗装备国家工程研究中心口腔数字医学北京市重点实验室,北京 100081;
²清华大学计算机系,北京 100084

收稿日期:2022-05-16 出版日期:2023-01-01 发布日期:2022-12-29
通讯作者: 刘云松, Email: kqliuyunsong@163.com
基金资助:
北京大学口腔医学院2020年度口腔医学院教学改革资助项目(2020-PT-10); 2022北京大学“教学新思路2.0”项目(YX22003);北京大学医学部教育教学研究课题(2022ZD05)

Study of artificial intelligence face recognition technology for real-time assessment of medical students' classroom concentration

Yang Jingwen¹, Yang Zonghan², Li Jian¹, Liu Yunsong¹

¹Department of Prosthodontics, Peking University School and Hospital of Stomatology & National Center of Stomatology & National Clinical Research Center for Oral Diseases & National Engineering Research Center of Oral Biomaterials and Digital Medical Devices & Beijing Key Laboratory of Digital Stomatology, Beijing 100081, China;
²Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China

Received:2022-05-16 Online:2023-01-01 Published:2022-12-29
Contact: Liu Yunsong,Email:kqliuyunsong@163.com
Supported by:
Teaching Reform Funding Project of Peking University School and Hospital of Stomatology (2020-PT-10); 2022 “New Ideas in Teaching 2.0”in Peking University(YX22003); Peking University HSC Medical Education Research Funding Project (2022ZD05)

摘要/Abstract

摘要： 目的采用人工智能人脸识别技术(简称人脸识别技术)实时评估医学生课堂专注度,评价其在应用中的可靠性。方法 2021年10月,选取北京大学口腔医学院2018级五年制和八年制口腔医学专业80名学生为研究对象,收集其在牙体解剖学8个课时的课堂录像,采用人脸识别技术对录像资料转换的图片(每秒抽取1帧)进行人脸分析,用随机函数抽取全部图片数据的1/5作为检测数据集并输出其识别“专注”学生的人脸数量,同时由授课教师肉眼观察学生面部状态以进行“专注”学生的人工识别,计算人脸识别的准确率和查全率。通过Wilcoxon检验和组内相关系数(intraclass correlation coefficient,ICC)进行数据分析。结果对21 600张图片的“专注”学生进行人脸识别,4 320 张图片作为检测数据集,人脸识别的准确率为90.4%(41 288/45 668),查全率为81.4%(41 228/50 648)。人脸识别(378 830人次)和人工识别(345 689人次)专注”学生的差异无统计学意义(P=0.109);二者呈中等程度相关(ICC=0.65,P=0.026)。结论人脸识别技术能够有效判断医学生在课堂上的专注程度,可以为实时评估教学效果提供有效技术支持。

关键词: 学生,医科, 实时评估, 专注度, 教学评价, 人脸识别, 人工智能

Abstract: Objective To explore the feasibility of artificial intelligence face recognition technology (referred to as face recognition technology) in evaluating medical students' classroom concentration in real time. Methods In October 2021, 80 students of five-year and eight-year majors in stomatology enrolled in 2018 in Peking University School of Stomatology were selected as the research participants. Their classroom videos of 8 class hours in the dental anatomy course were collected, and face recognition technology was used. Perform face analysis on the pictures converted from video data (extract one frame per second) to evaluate the number of students who are “focused” in real time; a random function selects 1/5 of the entire picture data as the detection data, and judging whether the student is listening to the class attentively according to the naked eye observation of the student's facial state by the teachers, to carry out the manual identification of “focused” students, calculate the accuracy and recall rate of face recognition. Wilcoxon test was used to analyze the difference between face recognition technology and human recognition. The consistency of face recognition and evaluator recognition results was tested by intraclass correlation coefficient (ICC). Results Artificial intelligence recognized the face of “focused” students with 21 600 pictures, and 4 320 pictures were used as detection data sets for manual marking. The accuracy of face recognition was 90.4% (41 288/45 668), and the recall rate was 81.4% (41 228/50 648). There was no significant difference between face recognition (378 830 person times) and manual recognition (345 689 person times); They were moderately correlated (ICC=0.65, P=0.026). Conclusions Face recognition technology can effectively judge the concentration of students in the classroom and can provide an effective technical support for real-time evaluation of teaching effect.

Key words: Students, medical, Real-time evaluation, Concentration, Teaching evaluation, Face recognition, Artificial intelligence

中图分类号:

杨静文, 杨宗瀚, 李健, 刘云松. 人工智能人脸识别技术在实时评估医学生课堂专注度中的应用研究[J]. 中华医学教育杂志, 2023, 43(1): 31-34.

Yang Jingwen, Yang Zonghan, Li Jian, Liu Yunsong. Study of artificial intelligence face recognition technology for real-time assessment of medical students' classroom concentration[J]. Chinese Journal of Medical Education, 2023, 43(1): 31-34.

参考文献

[1] LaVelle JM, Lovato C, Stephenson CL. Pedagogical considerations for the teaching of evaluation[J]. Eval Program Plann, 2020,79:101786. DOI: 10.1016/j.evalprogplan.2020.101786.
[2] Tao Y, He Y, Zhang W. An application of face recognition technology in university classroom teaching[C]//2020 IEEE 2nd International Conference on Computer Science and Educational Informatization (CSEI). Xinxiang, China:IEEE, 2020:190-193.
[3] Whitehill J, Serpell Z, Lin Y, et al. The faces of engagement: automatic recognition of studentengagement from facial expressions[J].IEEE T AFFECT COMPUT,2014,5(1):86-98.DO1:10.1109/TAFFC.2014.2316163.
[4] Miao X, Yu Z, Liu M. Using partial differential equation face recognition model to evaluate students' attention in a college chinese classroom[J]. Advances in Mathematical Physics, 2021(7): 1-10. DOI:10.1155/2021/3950445.
[5] Yang B, Yao Z, Lu H, et al. In-classroom learning analytics based on student behavior, topic and teaching characteristic mining[J]. Pattern Recognition Letters, 2020,129: 224-231. DOI:10.1016/j.patrec.2019.11.023.
[6] Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research [J]. J Chiropr Med, 2016,15(2):155-163. DOI: 10.1016/j.jcm.2016.02.012.
[7] Zhang X, Zhang X, Dolah J. Intelligent classroom teaching assessment system based on deep learning model face recognition technology[J/OL]. Scientific Programming, 2022(6):1-10[2022-11-10] . DOI:10.1155/2022/1851409.
[8] Tang J, Zhou X, Zheng J. Design of intelligent classroom facial recognition based on deep learning[J]. Journal of Physics Conference Series, 2019,1168(2):022043. DOI:10.1088/1742-6596/1168/2/022043.
[9] Song Z. Facial expression emotion recognition model integrating philosophy and machine learning theory[J]. Front Psychol, 2021,12:759485. DOI: 10.3389/fpsyg.2021.759485.

人工智能人脸识别技术在实时评估医学生课堂专注度中的应用研究

Study of artificial intelligence face recognition technology for real-time assessment of medical students' classroom concentration

PDF (Mobile)

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 7

编辑推荐

Metrics

本文评价

[1]	李佳梅, 任玉兰, 杨瑶, 苏茜. 思政视域下妇产科护理学进阶式混合教学探索与实践[J]. 中华医学教育杂志, 2022, 42(10): 898-902.
[2]	柳丽花, 张军, 刘晶, 彭骏, 丁静林. 依托SPOC的形成性评价在医学文献检索课程教学中的应用[J]. 中华医学教育杂志, 2021, 41(3): 276-279.
[3]	黄广仕, 周梦强, 韩春梅, 吕萍, 吴及. 人工智能深度学习技术在医学考试试题难度预估中的应用研究[J]. 中华医学教育杂志, 2021, 41(10): 932-935.
[4]	贾晶雅, 张燕平, 霍晓旭, 苗汝娟, 马菲. 翻转课堂在本科流行病学教学中的应用[J]. 中华医学教育杂志, 2018, 38(6): 834-837.
[5]	谭春苗, 周向东, 朱艳, 符丽. 基于师生一体化临床实习教学模式对实习护士护理核心能力培养效果的评价[J]. 中华医学教育杂志, 2018, 38(3): 355-359.
[6]	张守华, 罗长坤, 秦宇彤, 徐迪雄, 黄建军, 黄国琼, 黄继东, 陈建南, 陈俊国, 王方芳, 沈娟. 基于师生期望的教学方法评价模式研究[J]. 中华医学教育杂志, 2017, 37(5): 743-748.
[7]	温宇, 张艾, 陈瑜, 周建华, 罗小平. 五年制临床医学专业学生儿科学考试试卷分析的实践研究[J]. 中华医学教育杂志, 2017, 37(4): 626-629.