An exploration of constructing an assessment tool for the implementation of medical scenario-based simulation based on Delphi-AHP method

doi:10.3760/cma.j.cn115259-20240116-00058

Abstract

Abstract: Objective To construct an assessment tool for the implementation of scenario-based simulation. Methods From November 2023 to January 2024, 10 healthcare simulation education experts from various clinical specialties and different regions across the country were selected for the inquiry. Through literature review and Delphi expert consultation, the items of the assessment tool were determined, and the weights of the indicators were determined through the analytic hierarchy process. Results The expert positive coefficients of the two rounds of consultation were both 100%, and the authority coefficients were both 0.975. Kendall coefficients of the two rounds of consultation were respectively 0.143 and 0.117(P<0.01). An assessment tool for the implementation of scenario-based simulation was formed, including 4 first-level items, 12 second-level items, 36 third-level items. The results of the analytic hierarchy process showed that the CR values of each matrix of three-level items were all less than 0.001, which met requirements of the consistency test. Conclusions The assessment tool for the implementation of scenario-based simulation constructed in this study is objective and reliable, providing reference and basis for objective assessment and guidance of the implementation of scenario-based simulation.

Key words: Medicine, Scenario-based simulation, Course implementation, Assessment tool

CLC Number:

Wang Jiayu, Shi Ting, Xu Lingling. An exploration of constructing an assessment tool for the implementation of medical scenario-based simulation based on Delphi-AHP method[J]. Chinese Journal of Medical Education, 2025, 45(3): 235-240.

References

[1] Kolb DA. Experiential learning: experience as the source of learning and development, second edition [M]. NewJersey:Pearson FT Press, 2014:31-64.
[2] 龙晓焕,王西富,关天悦,等. 医学模拟教育中复盘教学方法的发展和应用综述[J]. 中华医学教育杂志,2022,42(3):241-245. DOI:10.3760/cma.j.cn115259-20210826-01080.
[3] 管静,金晓燕,董旭,等. 模拟教学中护理教师实施引导性反馈的现况调查[J].中华护理教育, 2021,18(11):965-972. DOI:10.3761/j.issn.1672-9234.2021.11.001.
[4] Tanoubi I, Labben I, Guédira S, et al. The impact of a high fidelity simulation-based debriefing course on the debriefing assessment for simulation in healthcare (DASH) score of novice instructors[J].Adv Med Educ Prof, 2019,7(4):159-164. DOI: 10.30476/jamp.2019.74583.0.
[5] Abulebda K, Srinivasan S, Maa T, et al. Development, implementation, and evaluation of a faculty development workshop to enhance debriefing skills among novice facilitators[J].Cureus, 2020,12(2):e6942. DOI: 10.7759/cureus.6942.
[6] Couto TB, Matos FM, de ToledoRodovalho PD, et al. Translation of the debriefing assessment for simulation in healthcare in portuguese and cross-cultural adaptation for Portugal and Brazil[J].Adv Simul, 2021,6(1):25. DOI: 10.1186/s41077-021-00175-z.
[7] 陈志桥,李力,刘小平,等.Debriefing在医学领域中的应用:基于Web of Science数据的文献计量学分析[J].中华医学教育探索杂志, 2020, 19(11):1251-1254. DOI:10.3760/cma.j.cn116021-20191203-00291.
[8] Lioce L, Meakim C. H, Fey M. K, et al. Standards of best practice: Simulation standard IX: simulation design[J].Clinical Simulation in Nursing, 2015,11(6): 309-315. DOI:10.1016/j.ecns.2015.03.005.
[9] 中国医师协会. 中国医师协会关于发布《住培基地临床技能培训中心工作指南(2023年版)》的通知[EB/OL].(2023-05-17)[2024-01-07].https://www.ccgme-cmda.cn/news/16471/article.
[10] 王佳玉,何竑超,江哲涵,等. 基于Delphi-AHP法构建经尿道前列腺切除手术关键技术评价量表[J]. 中国毕业后医学教育,2023,7(7):551-554,570. DOI:10.3969/j.issn.2096-4293.2023.07.010.
[11] 马广信. 临床医学本科毕业生质量评价指标体系研究[D]. 重庆:第三军医大学,2007.
[12] 孟丽红,刘盎,贾龙强,等. 基于德尔菲法的胃管置入术风险评估表的构建[J]. 护理研究,2019,33(16):2875-2877. DOI:10.12102/j.issn.1009-6493.2019.16.033.
[13] 侯菁媛,钱文溢,王萱萱,等. 基于成果导向教育理念的医学院校学生评教指标体系构建研究[J]. 中华医学教育杂志,2024,44(6):454-457. DOI:10.3760/cma.j.cn115259-20231031-00421.
[14] 曾光. 现代流行病学方法与应用[M].北京医科大学中国协和医科大学联合出版社,1996:251.
[15] 徐杭,侯建林,王维民. 调控本科临床医学专业招生规模的院校教育资源指标体系构建[J]. 中华医学教育杂志,2024,44(1):1-5. DOI:10.3760/cma.j.cn115259-20230206-00101.
[16] INACSL Standards Committee. INACSL standards of best practice:simulation^SM debriefing[J].Clinical Simulation in Nursing, 2016,12(S): S21-S25. DOI:10.1016/j.ecns.2016.09.008.
[17] Dopelt K, Shevach I, Vardimon OE, et al. Simulation as a key training method for inculcating public health leadership skills: a mixed methods study[J].Front Public Health. 2023,11:1202598. DOI:10.3389/fpubh.2023.1202598.
[18] Brett-Fleegler M, Rudolph J, Eppich W, et al. Debriefing assessment for simulation in healthcare: development and psychometric properties[J].Simul Healthc, 2012,7(5):288-294. DOI: 10.1097/SIH.0b013e3182620228.
[19] Arora S, Ahmed M, Paige J, et al. Objective structured assessment of debriefing:bringing science to the art of debriefing in surgery[J].Ann Surg, 2012, 256: 982-988. DOI:10.1097/SLA.0b013e3182610c91.
[20] Zhang XC, Lee H, Rodriguez C, et al. A novel approach to debriefing medical simulations: the six thinking hats[J].Cureus, 2018, 10(4): e2543. DOI: 10.7759/cureus.2543.
[21] INACSL Standards Committee. INACSL standards of best practice:simulation^SM professional integrity[J].Clinical Simulation in Nursing, 2016,12(S): S30-S33. DOI:10.1016/j.ecns.2016.09.010.
[22] INACSL Standards Committee. INACSL standards of best practice:simulation^SM: operations[J].Clinical Simulation in Nursing, 2017,13(12): 681-687. DOI:10.1016/j.ecns.2017.10.005.
[23] Decker S, Fey M,Sideras S, et al. Standards of best practice: simulation standard VI: the debriefing process[J]. Clin Simul Nurs, 2013, 9(6): S26-S29. DOI:10.1016/j.ecns.2013.04.008.
[24] Rudolph JW,Raemer DB, Simon R. Establishing a safe container for learning in simulation: the role of the presimulation briefing[J]. Simul Health, 2014,9(6):339-349. DOI: 10.1097/SIH.0000000000000047.
[25] 杨冰香,黄润,徐爱京,等. 模拟教学引导性反馈的标准和策略[J]. 中华护理教育,2020,17(1):18-23. DOI:10.3761/j.issn.1672-9234.2020.01.003.
[26] Page-Cutrara K. Use of prebriefing in nursing simulation: a literature review[J]. J Nurs Educ, 2014,53(3):136-141. DOI:10.3928/01484834-20140211-07.