Application of DOPS relying on network platform in surgical clinical skill assessment of undergraduates majoring in traditional Chinese medicine

doi:10.3760/cma.j.cn115259-20200216-01562

Abstract

Abstract: Objective To evaluate the effect of direct observation of procedural skills (DOPS) and outcome assessment supported by Questionnaire survey and WeChat in assessment of surgical internship by undergraduates of traditional Chinese medicine(TCM)program. Methods Improved DOPS evaluation form was formulated. From June 2018 to December 2019, 180 students in the Department of Surgery of the Second Clinical Medical College, Beijing University of Chinese Medicine, were selected to conduct a DOPS assessment of surgical clinical skill in the early, middle and later stages. The results of each assessment were statistically analyzed and given real-time feedback by Questionnaire survey and WeChat. Students at early and later stages were asked to fill in the satisfaction questionnaire. Results The scores of late DOPS assessment (5.44±0.13) were higher than those of early DOPS assessment (4.20±0.21) and middle DOPS assessment (4.44±0.13), (P<0.01). For the satisfaction of DOPS assessment results, the scores from teachers were (7.33±1.51), (7.52±1.33), (8.52±0.53), and the students were (6.72±1.55), (7.22±1.40), (8.21±1.09) respectively in the early, middle and later stages. The score of later stage was higher than that of middle stage and that of middle stage was higher than that of early stage (P<0.01). The results of the questionnaire survey among the students in early and later stage indicated that the contribution to improve teaching results was recognized with the highest score in the later stage [4.81±0.42], which was higher than that in the early stage [4.50±0.61] (P<0.01). Conclusions The application of the improved DOPS supported by a network Questionnaire and WeChat platform in the examination of surgical clinical skills has been recognized by teachers and students, which contributes to the improvement of surgical clinical operation skills of student.

Key words: Direct observation of procedural skills, Surgical internship, Traditional Chinese medicine, Clinical skill, Examination

CLC Number:

Liu Baoqing, Zhang Fanfan, Zhang Shaohui, Yang Chengcheng, Yu Wen, Liu Wenna, Wang Gesheng, Dong Xiaobo, Liu Jialin, An Jialin. Application of DOPS relying on network platform in surgical clinical skill assessment of undergraduates majoring in traditional Chinese medicine[J]. Chinese Journal of Medical Education, 2021, 41(7): 647-651.

References

[1] Siau K, Dunckley P, Valori R, et al. Changes in scoring of Direct Observation of Procedural Skills (DOPS) forms and the impact on competence assessment[J]. Endoscopy, 2018,50(8):770-778. DOI: 10.1055/a-0576-6667.
[2] Erfani Khanghahi M, Ebadi Fard Azar F. Direct observation of procedural skills (DOPS) evaluation method: systematic review of evidence[J]. Med J Islam Repub Iran, 2018,32:45. DOI: 10.14196/mjiri.32.45.
[3] Wragg A, Wade W, Fuller G, et al. Assessing the performance of specialist registrars[J]. Clin Med (Lond), 2003,3(2):131-134. DOI: 10.7861/clinmedicine.3-2-131.
[4] Augustine K, McCoubrie P, Wilkinson JR, et al. Workplace-based assessment in radiology-where to now?[J]. Clin Radiol, 2010,65(4):325-332. DOI: 10.1016/j.crad.2009.12.004.
[5] Barton JR, Corbett S, van der Vleuten CP. The validity and reliability of a direct observation of procedural skills assessment tool: assessing colonoscopic skills of senior endoscopists[J]. Gastrointest Endosc, 2012,75(3):591-597. DOI: 10.1016/j.gie.2011.09.053.
[6] 姚睿智, 谢玉琼, 王燕, 等. 中医专业外科临床技能考核的方法探讨[J].临床医学工程,2009,16(1):80-81. DOI: 10.3969/j.issn.1674-4659.2009.01.043.
[7] 王松, 代松, 张帅, 等. 基于“互联网+教育”下PBL模式在临床教学中的应用[J].中国继续医学教育,2021,13(11):20-24. DOI: 10.3969/j.issn.1674-9308.2021.11.006.
[8] 刘宏芝, 肖映胜, 李植锋, 等. 微信支持下的Mini-CEX联合DOPS在肿瘤学临床教学考核中的应用[J].中华医学教育杂志,2020,40(5):362-366. DOI: 10.3760/cma.j.cn115259-20190423-00312.
[9] 张凡帆, 刘文娜, 杨成城, 等. 依托网络平台进行形成性评价在西医外科学教学中的应用[J].中国继续医学教育,2018,10(26):41-43. DOI: 10.3969/j.issn.1674-9308.2018.26.018.
[10] 高璐, 高晶, 李红伟, 等. 以DOPS为工具的形成性评价在临床技能教学中的应用研究[J].中国医学教育技术,2017,31(6):714-716. DOI: 10.13566/j.cnki.cmet.cn61-1317/g4.201706027.
[11] 蒯乐, 章婷婷, 许建敏, 等. DOPS在针灸操作技能教学中的应用与评价[J].中华医学教育探索杂志,2013,12(11):1081-1084. DOI: 10.3760/cma.j.issn.2095-1485.2013.11.001.
[12] Lörwald AC, Lahner FM, Greif R, et al. Factors influencing the educational impact of Mini-CEX and DOPS: a qualitative synthesis[J]. Med Teach, 2018,40(4):414-420. DOI: 10.1080/0142159X.2017.1408901.
[13] Awad Z, Hayden L, Muthuswamy K, et al. Does direct observation of procedural skills reflect trainee's progress in otolaryngology?[J]. Clin Otolaryngol, 2014,39(3):169-173. DOI: 10.1111/coa.12251.
[14] Hoseini BL, Mazloum SR, Jafarnejad F, et al. Comparison of midwifery students' satisfaction with direct observation of procedural skills and current methods in evaluation of procedural skills in Mashhad Nursing and Midwifery School[J]. Iran J Nurs Midwifery Res, 2013,18(2):94-100.
[15] Farajpour A, Amini M, Pishbin E, et al. Using modified direct observation of procedural skills (DOPS) to assess undergraduate medical students[J]. J Adv Med Educ Prof, 2018,6(3):130-136.