Construction and reflection on the process evaluation system of professional bases for standardized residency training

doi:10.3760/cma.j.cn115259-20230222-00166

Abstract

Abstract: Objective To construct a process evaluation system of professional bases for standardized residency training (referred to as ″residency training″). Methods From December 2022 to March 2023, anevaluation index system of professional bases for standardized residency training was constructed based on the context-input-process-product evaluation model (CIPP model), drawing on the core competency framework for residents in China, using the Delphi method, and Cronbach's coefficient and content validity index to calculate the reliability and validity of the expert consultation questionnaire. Results Eighteen experts from nine specialties in three hospitals of Central South University were selected for consultation, and the expert authority coefficient was 0.867. The constructed index system included four first-level indexes (content, input, process, and product), seven second-level indexes (training objectives, quality of the student population, training program, teaching level of the supervising physician, competency level of the residents, results of the residency completion assessment, and residents' employment status) and 18 tertiary indicators, and the specific content and scoring method of each indicator were clarified. The Cronbach's coefficient of the second round of expert consultation questionnaire was 0.937, and the content validity index was 0.960. Conclusions The process evaluation system of the professional base of residency training constructed based on the CIPP model is authoritative, and the index system has a good degree of credibility and validity, which realizes the evaluation of the whole process of the training in the professional base of residency training, and the dynamic monitoring of the professional base, promotes the connotation construction of residency training, and helps to guarantee and improve the competence of residents.

Key words: Evaluation studies, Standardized residency training, Professional base, Competency orientation, Context-input-process-product evaluation model, Process evaluation, Index system, Delphi method

CLC Number:

R-05

Xie Wenzhao, He Qingnan. Construction and reflection on the process evaluation system of professional bases for standardized residency training[J]. Chinese Journal of Medical Education, 2024, 44(1): 58-62.

References

[1] 中国医师协会.中国医师协会关于印发住培内容与标准、基地标准(2022年版)的通知[EB/OL]. (2022-08-15)[2023-03-10].https://www.ccgme-cmda.cn/news/15117/article.
[2] 方才妹, 吴振龙. 2018年住院医师规范化培训基地评估特点浅析[J].中国毕业后医学教育,2019,3(2):97-102.
[3] 方才妹, 周玉皆, 胡素佩, 等. 住院医师规范化培训基地评估与认证一体化实施的思考[J].中国毕业后医学教育,2021,5(5):385-390. DOI: 10.3969/j.issn.2096-4293.2021.05.001.
[4] 姜晓莹, 陈予宁, 陈蓬来, 等. 住院医师规范化培训基地和专业基地协同运作的实践与思考[J].全科医学临床与教育,2021,19(8):673-675. DOI: 10.13558/j.cnki.issn1672-3686.2021.008.001.
[5] 周玉皆, 康丽娜, 乔羽, 等. 内科专业基地评估存在的问题及建议[J].中国毕业后医学教育,2018,2(1):18-21,25.
[6] 李腾飞. 新时代教师专业发展过程性评价体系初探[J].教育实践与研究,2023(15):8-10.
[7] 王强, 顾志娥, 陈晖, 等. 基于信息技术的过程管理联动院级督导对住培教学活动、培训质量的影响[J].江苏卫生事业管理,2022,33(6):820-823. DOI: 10.3969/j.issn.1005-7803.2022.06.034.
[8] 战京燕, 王少坤, 娄景秋, 等. 基于PDCA循环的院级督导在提高住培教学阅片质量和内涵建设中的作用[J].中国毕业后医学教育,2023,7(6):467-471. DOI: 10.3969/j.issn.2096-4293.2023.06.009.
[9] 黄虑, 姜昊文, 周颖杰, 等. 住院医师规范化培训基地形成性评价的实施与管理[J].中国继续医学教育,2022,14(11):190-193. DOI: 10.3969/j.issn.1674-9308.2022.11.050.
[10] Gandomkar R. Comparing Kirkpatrick's original and new model with CIPP evaluation model[J]. J Adv Med Educ Prof, 2018,6(2):94-95.
[11] Holmboe ES, Sherbino J, Englander R, et al. A call to action: the controversy of and rationale for competency-based medical education[J]. Med Teach, 2017,39(6):574-581. DOI: 10.1080/0142159X.2017.1315067.
[12] 王金梅. 基于CIPP模型的护理本科人才培养核心竞争力评价指标体系的构建与初步应用研究[D]. 南昌:南昌大学,2022.
[13] Ten Cate O. Competency-based postgraduate medical education: past, present and future[J]. GMS J Med Educ, 2017,34(5):Doc69. DOI: 10.3205/zma001146.
[14] Frenk J, Chen L, Bhutta ZA, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world[J]. Lancet, 2010,376(9756):1923-1958. DOI: 10.1016/S0140-6736(10)61854-5.
[15] 李海潮. 第二代医学教育改革与胜任力导向医学教育的关系分析[J].中华医学教育杂志,2019,39(11):801-806. DOI: 10.3760/cma.j.issn.1673-677X.2019.11.001.
[16] 蓝妍玲, 乡汝浩, 刘智慧, 等. 带教师资视角下的住院医师规范化培训现状与对策研究——基于CIPP评价模型[J].现代医院,2023,23(1):133-136,139. DOI: 10.3969/j.issn.1671-332X.2023.01.037.
[17] 刘明鼎, 张艳敏. 基于CIPP评价模型的混合式教学模式评价体系构建探究[J].吉林省教育学院学报,2023,39(3):127-134. DOI: 10.16083/j.cnki.1671-1580.2023.03.023.
[18] 王勤, 熊丽娟, 熊莉娟. 基于德尔菲专家咨询法构建综合医院病区分类评价指标研究[J].护理研究,2019,33(13):2345-2347. DOI: 10.12102/j.issn.1009-6493.2019.13.040.
[19] 孙振球.医学统计学[M].2版.北京:人民卫生出版社,2006:510-514.
[20] 薛晓琳, 王天芳, 于春光, 等. 疲劳自评量表的信、效度评价[J].中国中西医结合杂志,2008,28(6):550-554. DOI: 10.3321/j.issn:1003-5370.2008.06.019.
[21] 史静琤, 莫显昆, 孙振球. 量表编制中内容效度指数的应用[J].中南大学学报(医学版),2012,37(2):152-155. DOI: 10.3969/j.issn.1672-7347.2012.02.007.
[22] 白娟, 禄保平, 张超. 加强住院医师规范化培训信息化平台建设的思考[J].中医药管理杂志,2021,29(5):183-186.
[23] 祁伟, 张卓, 李晓瑜, 等. 住院医师规范化培训信息化管理系统建设的思考[J].中国继续医学教育,2023,15(10):174-177. DOI: 10.3969/j.issn.1674-9308.2023.10.039.