Reliability research on the wearable recording equipment applied in the clinical skill evaluation

doi:10.3760/cma.j.issn.1673-677X.2017.06.032

Abstract

Abstract: Objective To study the reliability of wearable recording equipment used in the medical operation skills evaluation.Methods The wearable recording equipment were used to record 39 students' medical operation skill performance in a test, 3 examiners give score through watching the video. 1 of the 3 examiners does the on-site evaluation as well. Through the comparison of on-site score and video score, to test copy reliability, rater reliability and test-retest reliability of the wearable recording equipment.Results The copy reliability (0.486), rater reliability (0.934 and 0.611) and test-retest reliability (0.918 and 0.903) are high.Conclusions Without the influence on the students, the equipment can capture more details of their performance. With the help of the record, the examiners can evaluate the students in a different time and difference place.

Key words: Wearable recording equipment, Reliability research, Clinical medicine, Skill evaluation

Liu Jiazhen, Lu Yaohong, Zou Yang, Wang Hong, Wang Daozhen, Li ping. Reliability research on the wearable recording equipment applied in the clinical skill evaluation[J]. Chinese Journal of Medical Education, 2017, 37(6): 952-955.

References

[1] 卢燕, 续岩, 马俊红, 等. 基于医学生视角的客观结构化临床考试评价[J]. 中华医学教育杂志, 2014, 34(4): 624-628. DOI: 10.3760/cma.j.issn.1673-677X.2014.04.044.
Lu Y, Xu Y, Ma JH, et al. The evaluation of objective structured clinical examination based on students' perspective[J]. Chin J Med Edu, 2014, 34(4): 624-628. DOI: 10.3760/cma.j.issn.1673-677X.2014.04.044.
[2] 景汇泉, 张颖, 韩松, 等. 国家医师资格实践技能考试合格标准设置探析[J].中华医学教育杂志, 2014, 34(3): 466-469. DOI: 10.3760/cma.j.issn.1673-677X.2014.03.042.
Jing HQ, Zhang Y, Han S, et al. Exploration of the establishment of qualified standard for clinical skill test of national medical licensing examination[J]. Chin J Med Edu, 2014, 34(3): 466-469. DOI: 10.3760/cma.j.issn.1673-677X.2014.03.042.
[3] 贾同英, 袁蕙芸. 多院区医院管理难点与对策探析[J].中国医院, 2014(8):28-30.
Jia TY, Yuan HY. Analysis on management difficulties and its countermeasures on multi-campuses hospitals[J]. Chinese Hospitals, 2014 (8):28-30.
[4] Kneebone R, Bello F, Nestel D, et al. Learner-centred feedback using remote assessment of clinical procedures[J]. Med Teach, 2008, 30(8): 795-801. DOI: 10.1080/01421590801949941.
[5] Lentz LM, Fincher RM. Using telemedicine and standardized patients to evaluate off-campus students' skills[J]. Acad Med, 1999, 74(5): 598-599.
[6] Parish SJ, Weber CM, Steiner-Grossman P, et al. Teaching clinical skills through videotape review: A randomized trial of group versus individual reviews[J]. Teach Learn Med, 2006, 18(2): 92-98. DOI: 10.1207/s15328015tlm1802_1.
[7] 重测信度的概念及使用注意事项[J]. 中国护理管理, 2016, 16(12): 1612-1612. Chinese Nursing Management,2016,16(12):1612.
[8] 王远库. 关于个体记忆增长与记忆遗忘的数学模型[J]. 榆林学院学报, 2007, 17(4): 31-32. DOI: 10.3969/j.issn.1008-3871.2007.04.011.
[9] 一帆.复本信度[J].教育测量与评价(理论版), 2015(3): 64.

[1]	Zhang Jin, Yang Libin, Guo Qingfeng, Cao Depin. Application of formative assessment in undergraduate clinical medicine education [J]. Chinese Journal of Medical Education, 2020, 40(9): 731-735.
[2]	Dong Yali, Zhao Ting, Gu Xiaofen. The current status and influencing factors of anxiety and depression in professional master degree of clinical medicine in a medical college [J]. Chinese Journal of Medical Education, 2020, 40(8): 586-589.
[3]	Fan Yujie, You You, Li Feng, Wang Weimin, Chen Juan. Student engagement and its impact on learning outcomes of undergraduates of clinical medicine [J]. Chinese Journal of Medical Education, 2020, 40(8): 632-636.
[4]	Wu Hongbin, Xie A'na, Wang Weimin. Retrospect and prospect of eight-year medical education program in China [J]. Chinese Journal of Medical Education, 2020, 40(7): 513-518.
[5]	Liao Peng, Hou Jianlin, Liao Kaiju, Li Fei, Ma Xuanxuan, Wang Zhifeng. Quantity and geographic distribution of colleges offering undergraduate clinical medicine program in China [J]. Chinese Journal of Medical Education, 2020, 40(7): 519-523.
[6]	Jiang Xiaogang, Yang Xudong, Yan Xiaofei, Han Yan. Effectiveness of the comprehensive experiment of biochemistry and molecular biology in clinical medicine [J]. Chinese Journal of Medical Education, 2020, 40(6): 455-457.
[7]	Zhang Chi, Wang Tingting, Jia Jinzhong, Liu Deping, Wang Peizhong. Qualitative research on professional degree education of medical doctor [J]. Chinese Journal of Medical Education, 2020, 40(5): 367-371.
[8]	Liao Kaiju, Hou Jianlin, Yu Chen, Xie A'na, Wang Weimin. Analysis on the enrolment scale of undergraduate medical education in China's regular higher education institutions and related policy suggestions [J]. Chinese Journal of Medical Education, 2020, 40(4): 252-255.
[9]	Jia Xueyan, Duan Lili, Chang Xing, Zhu Dongwei, Luo Linzhi, Qiu Jie. Study on ideological education model for postgraduates of clinical medicine [J]. Chinese Journal of Medical Education, 2020, 40(4): 293-296.
[10]	Huo Gang, Tao Liyuan, Zhang Aijing, Yuan Wenqing, Gu Shixian. Investigation and analysis of the current situation of clinical medicine academic graduate tutor guidance in an affiliated hospital of a university in Beijing [J]. Chinese Journal of Medical Education, 2020, 40(4): 297-300.
[11]	Yang Chaoqun, Lai Jingwei, Cheng Yaqing, Liu Zeyu, Deng Guoying. An investigation on the intention of senior high school students for entrance into medicine college and reasons [J]. Chinese Journal of Medical Education, 2020, 40(11): 858-862.
[12]	Wu Tao, Xiao Zhihong, Yan Xueliang. The application of 3D printing technology in undergraduates teaching of spinal surgery [J]. Chinese Journal of Medical Education, 2020, 40(10): 792-795.
[13]	Li Hui, Xu Yi, Chang Xiaohong. Problems and strategies in the progress of postgraduate education for clinical medicine professional degree [J]. Chinese Journal of Medical Education, 2020, 40(1): 56-59.
[14]	Zhang Chi, Jia Jinzhong, Jiang Yingying, Wang Tingting. Exploration on the training objectives and requirements of professional deoctoral degree in clinical medicine in China [J]. Chinese Journal of Medical Education, 2019, 39(9): 691-695.
[15]	Li Yifeng, Li Niannian, Ye Ren, Zhao Jiayun. Analysis of blind evaluation results of master's degree thesis of clinical medicine in different culture types [J]. Chinese Journal of Medical Education, 2019, 39(9): 696-700.