Study of artificial intelligence face recognition technology for real-time assessment of medical students' classroom concentration

doi:10.3760/cma.j.cn115259-20220516-00628

Chinese Journal of Medical Education ›› 2023, Vol. 43 ›› Issue (1): 31-34.DOI: 10.3760/cma.j.cn115259-20220516-00628

Previous Articles Next Articles

Study of artificial intelligence face recognition technology for real-time assessment of medical students' classroom concentration

Yang Jingwen¹, Yang Zonghan², Li Jian¹, Liu Yunsong¹

¹Department of Prosthodontics, Peking University School and Hospital of Stomatology & National Center of Stomatology & National Clinical Research Center for Oral Diseases & National Engineering Research Center of Oral Biomaterials and Digital Medical Devices & Beijing Key Laboratory of Digital Stomatology, Beijing 100081, China;
²Department of Computer Science and Technology, Tsinghua University, Beijing 100084, China

Received:2022-05-16 Online:2023-01-01 Published:2022-12-29
Contact: Liu Yunsong,Email:kqliuyunsong@163.com
Supported by:
Teaching Reform Funding Project of Peking University School and Hospital of Stomatology (2020-PT-10); 2022 “New Ideas in Teaching 2.0”in Peking University(YX22003); Peking University HSC Medical Education Research Funding Project (2022ZD05)

Abstract

Abstract: Objective To explore the feasibility of artificial intelligence face recognition technology (referred to as face recognition technology) in evaluating medical students' classroom concentration in real time. Methods In October 2021, 80 students of five-year and eight-year majors in stomatology enrolled in 2018 in Peking University School of Stomatology were selected as the research participants. Their classroom videos of 8 class hours in the dental anatomy course were collected, and face recognition technology was used. Perform face analysis on the pictures converted from video data (extract one frame per second) to evaluate the number of students who are “focused” in real time; a random function selects 1/5 of the entire picture data as the detection data, and judging whether the student is listening to the class attentively according to the naked eye observation of the student's facial state by the teachers, to carry out the manual identification of “focused” students, calculate the accuracy and recall rate of face recognition. Wilcoxon test was used to analyze the difference between face recognition technology and human recognition. The consistency of face recognition and evaluator recognition results was tested by intraclass correlation coefficient (ICC). Results Artificial intelligence recognized the face of “focused” students with 21 600 pictures, and 4 320 pictures were used as detection data sets for manual marking. The accuracy of face recognition was 90.4% (41 288/45 668), and the recall rate was 81.4% (41 228/50 648). There was no significant difference between face recognition (378 830 person times) and manual recognition (345 689 person times); They were moderately correlated (ICC=0.65, P=0.026). Conclusions Face recognition technology can effectively judge the concentration of students in the classroom and can provide an effective technical support for real-time evaluation of teaching effect.

Key words: Students, medical, Real-time evaluation, Concentration, Teaching evaluation, Face recognition, Artificial intelligence

CLC Number:

Yang Jingwen, Yang Zonghan, Li Jian, Liu Yunsong. Study of artificial intelligence face recognition technology for real-time assessment of medical students' classroom concentration[J]. Chinese Journal of Medical Education, 2023, 43(1): 31-34, DOI: 10.3760/cma.j.cn115259-20220516-00628.

References

[1] LaVelle JM, Lovato C, Stephenson CL. Pedagogical considerations for the teaching of evaluation[J]. Eval Program Plann, 2020,79:101786. DOI: 10.1016/j.evalprogplan.2020.101786.
[2] Tao Y, He Y, Zhang W. An application of face recognition technology in university classroom teaching[C]//2020 IEEE 2nd International Conference on Computer Science and Educational Informatization (CSEI). Xinxiang, China:IEEE, 2020:190-193.
[3] Whitehill J, Serpell Z, Lin Y, et al. The faces of engagement: automatic recognition of studentengagement from facial expressions[J].IEEE T AFFECT COMPUT,2014,5(1):86-98.DO1:10.1109/TAFFC.2014.2316163.
[4] Miao X, Yu Z, Liu M. Using partial differential equation face recognition model to evaluate students' attention in a college chinese classroom[J]. Advances in Mathematical Physics, 2021(7): 1-10. DOI:10.1155/2021/3950445.
[5] Yang B, Yao Z, Lu H, et al. In-classroom learning analytics based on student behavior, topic and teaching characteristic mining[J]. Pattern Recognition Letters, 2020,129: 224-231. DOI:10.1016/j.patrec.2019.11.023.
[6] Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research [J]. J Chiropr Med, 2016,15(2):155-163. DOI: 10.1016/j.jcm.2016.02.012.
[7] Zhang X, Zhang X, Dolah J. Intelligent classroom teaching assessment system based on deep learning model face recognition technology[J/OL]. Scientific Programming, 2022(6):1-10[2022-11-10] . DOI:10.1155/2022/1851409.
[8] Tang J, Zhou X, Zheng J. Design of intelligent classroom facial recognition based on deep learning[J]. Journal of Physics Conference Series, 2019,1168(2):022043. DOI:10.1088/1742-6596/1168/2/022043.
[9] Song Z. Facial expression emotion recognition model integrating philosophy and machine learning theory[J]. Front Psychol, 2021,12:759485. DOI: 10.3389/fpsyg.2021.759485.

[1]	Zhang Kunsong, Zhang Junlong, Feng Shaoting, Chen Wei, Kuang Ming, Xiao Haipeng. Opportunities, challenges and integration paths of medical humanities education in the AI era [J]. Chinese Journal of Medical Education, 2026, 46(4): 241-246.
[2]	Chen Lihua, Liu Shuo, Xin Siyan, Wang Yu, Wu Hongbin. A study on the influencing factors of the use of generative artificial intelligence by clinical medicine students [J]. Chinese Journal of Medical Education, 2026, 46(3): 199-205.
[3]	Wen Deliang, Wei Xiaotong. Application progress and future trends of artificial intelligence in medical education [J]. Chinese Journal of Medical Education, 2026, 46(1): 1-7.
[4]	Wei Xiaofan, Wu Jianghua, Chi Xiaochun, Zhang Weiguang, Peng Yihong. Exploring the path, challenges, and prospects of artificial intelligence in empowering human morphology curriculum construction [J]. Chinese Journal of Medical Education, 2026, 46(1): 8-14.
[5]	Zhu Jing, Wang Xiaofei, Zhou Weibing, Liu Hengyu. Visual analysis of research on generative artificial intelligence in medical education based on scientific citation databases [J]. Chinese Journal of Medical Education, 2025, 45(9): 661-665.
[6]	Wei Fangze, Liu Qian. Bibliometric study on the current application status of artificial intelligence in surgical education [J]. Chinese Journal of Medical Education, 2025, 45(9): 666-670.
[7]	Rong Xiaoying, Xu Mao, Zhou Yang, Gu Shixian, Qu Yinyin. Application of ChatGPT-assisted CBL teaching in anesthesia clerkship teaching for undergraduate medical students [J]. Chinese Journal of Medical Education, 2025, 45(8): 610-615.
[8]	Zhang Ruyi, Zhou Yun′ao, Peng Yingchun. Exploring collaborative governance pathways for artificial intelligence empowered medical education [J]. Chinese Journal of Medical Education, 2025, 45(7): 496-501.
[9]	Ding Min, Liu Shengjun, Sun Xiaoliang, Ma Ruolin, Gu Haojie, Shan Qiyuan, Kang Baoli, Xu Zengguang, Xu Wei, Chen Chi. Construction and application of an intelligent information management platform for a medical simulation center [J]. Chinese Journal of Medical Education, 2025, 45(7): 508-513.
[10]	Wang Kun, Hu Nan, Lu Haoping, Liu Wenzheng, Liu Zuojing. Survey on the need and efficacy of artificial intelligence systems in enhancing young physicians′ ability to manage emergencies of hematemesis [J]. Chinese Journal of Medical Education, 2025, 45(6): 423-427.
[11]	Chen Jiancong, Zhang Kunsong, Huang Xitai, Zhang Yunjian, Feng Shaoting, Kuang Ming. Applications and challenges of generative artificial intelligence in surgical teaching [J]. Chinese Journal of Medical Education, 2025, 45(3): 167-173.
[12]	Chai Hua, Yan Yujiang, Qing Ping. The empowerment of faculty development for medical educators through AI agent: a case study [J]. Chinese Journal of Medical Education, 2025, 45(3): 174-181.
[13]	Jiang Jianfa, Xiao Songshu. The application of ChatGPT in obstetrics and gynecology teaching [J]. Chinese Journal of Medical Education, 2025, 45(3): 182-186.
[14]	Xie Wenjia, Wang Zhengyang. Applications and challenges of artificial intelligence in postgraduate medical education [J]. Chinese Journal of Medical Education, 2025, 45(3): 187-193.
[15]	Ba Hongjun, Chen Jiarui, Hu Han, Jiang Xiaoyun, Li Shujuan. Survey on residents′ perception and attitudes towards the application of artificial intelligence [J]. Chinese Journal of Medical Education, 2025, 45(3): 194-197.

Study of artificial intelligence face recognition technology for real-time assessment of medical students' classroom concentration

PDF (Mobile)

Knowledge

Abstract

Cite this article

share this article

References

Related Articles 15

Recommended Articles

Metrics

Comments