Research on continuous improvement of objective structured clinical examination in standardized training of postgraduate year 1 surgery residents

doi:10.3760/cma.j.issn.1673-677X.2017.03.031

Abstract

Abstract: Objective To evaluate dynamically the outcome of the standardized training of postgraduate year 1 surgery residents at surgical school. To investigate the effectiveness and rationality of the improvedObjective structured clinical examination (OSCE).Methods According to the results of OSCE in 2015, the design and content of OSCE's stations were improved in 2016. The difficulty, discrimination and reliability of each station were calculated, and the correlation between each station was analyzed by SPSS 22.0. In addition, the results of OSCE's in 2016 were compared to that in 2015.Results The average OSCE score was (72.98±4.93). The difficulty of total stations was 0.730. The distinction was 0.683 and the reliability was 0.453. The first, second and sixth station were lowest difficulty, and the fourth and fifth station was moderate difficulty. Each station's discrimination was more than 0.400. The reliability of the sixth station was low. There were moderate correlation between the first station and the sixth station, the second station and the fourth station, as well as the second station and the sixth station. But there was no significant correlation between other stations. The scores of laparoscopic simulator basic skills in 2016 were significantly lower than that in 2015, but the station's reliability was higher in 2016. The scores of irregular wound debridement and suture in 2016 were significant higher than that in 2015.Conclusions Through the continuous improvement of OSCE, surgical school evaluates effectively the outcome of the standardized training of postgraduate year 1 surgery residents and improve the training effect step by step.

Key words: The standardized training of residents, Surgery school, Objective structured clinical examination (OSCE), Evaluation

Qi Xin, Li Nan, Liu Si, Li Yan, Li Haichao, Liu Yucun. Research on continuous improvement of objective structured clinical examination in standardized training of postgraduate year 1 surgery residents[J]. Chinese Journal of Medical Education, 2017, 37(3): 457-461.

References

[1] 齐心, 李岩, 李海潮, 等. 外科学校在外科住院医师规范化培训中的作用初探[J].中华医学教育杂志,2016,36(5):764-767. DOI:10.3760/cma.j.issn.1673-677X.2016.05.033.
Qi X, Li Y, Li HC, et al. A preliminary study on the role of surgery school in the standardized training of surgical residents[J]. Chin J Med Edu, 2016, 36(5) :764-767.DOI:10.3760/
cma.j.issn.1673-677X.2016.05.033.
[2] 齐心, 刘占兵, 翟伟, 等. 第1年住院医师基础外科培训综合考试结果解析[J].中华医学教育杂志,2016,36(4):629-632. DOI:10.3760/cma.j.issn.1673-677X.2016.04.036.
Qi X, Liu ZB, Zhai W, et al. The analysis about comprehensive examination results of PGY1 surgery residents[J]. Chin J Med Edu, 2016,36(4): 629-632. DOI:10.3760/cma.j.issn.1673-677X.2016.04.036.
[3] 朱滨海, 吴畏, 陈圆圆. 江苏省妇产科住院医师规范化培训结业考核中客观结构化临床考试的实施与评价[J]. 中华医学教育杂志,2014,34(5):788-792. DOI: 10.3760/cma.j.issn.1673-677X.2014.05.046.
Zhu BH, Wu W, Chen YY. Implementation and evaluation of objective structured clinical examination in residency standardized training graduation examination of gynecology and obstetrics in Jiangsu Province [J]. Chin J Med Edu, 2014, 34(5): 788-792. DOI: 10.3760/cma.j.issn.1673-677X.2014.05.046.
[4] 齐心, 刘占兵, 李海潮,等. ADDIE模式在基础外科教学中的应用[J]. 中华医学教育探索杂志,2016,15(4):422-425. DOI:10.3760/cma.j.issn.2095-1485.2016.04.025.
Qi X, Liu ZB, Li HC, et al. The application of ADDIE model for basic surgical education[J]. Chin J Med Edu Res, 2016,15(4):422-425. DOI:10.3760/cma.j.issn.2095-1485.2016.04.025.
[5] Chauvin SW. Applying educational theory to simulation-based training and assessment in surgery[J].Surg Clin North Am, 2015,95(4):695-715.DOI: 10.1016/j.suc.2015.04.006.
[6] Patil NG, Saing H, Wong J. Role of OSCE in evaluation of practical skills [J]. Med Teach, 2003, 25(3): 271-272. DOI:10.1080/0142159031000100319.
[7] 佟野, 赵霞, 于晓松, 等. 住院医师规范化培训阶段考核的研究[J]. 中华医学教育探索杂志, 2013,12(11):1171-1175. DOI:10.3760/cma.j.issn.2095-1485.2013.11.027.
Tong Y, Zhao X ,Yu XS. Study and exploration of stage assessment of standardized resident training[J]. Chin J Med Edu Res, 2013,12(11):1171-1175. DOI:10.3760/cma.j.issn.2095-1485.2013.11.027.
[8] Miller GE. The assessment of clinical skills/competence/performance[J]. Acad Med, 1990,65(9 suppl):s63-s67.
[9] Cruess RL,Cruess SR,Steinert Y. Amending Miller's pyramid to include professional identity formation[J]. Acad Med,2016,91(2):180-185. DOI: 10.1097/ACM.0000000000000913.

[1]	Wu Hengjing, Li Jinhui, Wu Jing, Qian Shulei, Zhao Aixia, Chen Lin. Study on the evaluation index system of medical postgraduate tutor in double first-class universities [J]. Chinese Journal of Medical Education, 2020, 40(9): 713-716.
[2]	Gu Feng, Qi Wenxiu, Meng Chang, Li Yujing, Xue Shilin, Yin Zhaodi, Li Meiyao, Lan Xueli, Zhang Meng. Evaluation of learning outcome by online teaching in medical undergraduates during COVID-19 pandemic [J]. Chinese Journal of Medical Education, 2020, 40(9): 726-730.
[3]	Yan Jun, Li Wentao, Zhao Shengnan, Jin Zhe, Wang Nan, Li Xiaoyang, An Libin. Development of information literacy evaluation tool for nursing teachers in colleges and universities [J]. Chinese Journal of Medical Education, 2020, 40(7): 569-573.
[4]	Wang Yujia, Jiao Liping, Wang Aihua, Wang Liping, Wang Tianyou. Evaluation of the standardized training's effect of pediatric residents in Beijing [J]. Chinese Journal of Medical Education, 2020, 40(5): 377-381.
[5]	Ruan Xia, Pei Lijian, Li Xu, Zhang Yu, Yu Chunhua, Yi Jie, Huang Yuguang. Application of diversified evaluation methods in standardized training of anesthesiologists [J]. Chinese Journal of Medical Education, 2020, 40(4): 301-305.
[6]	Zhang Wenbo, Su Jiazeng, Guo Yuxing, Wang Diancan, Shan Xiaofeng, Liu Shuming, Huang Mingwei, Guo Chuanbin, Peng Xin. Practice and evaluation of online PBL teaching in oral and maxillofacial oncology [J]. Chinese Journal of Medical Education, 2020, 40(11): 905-908.
[7]	Lyu Jing, Mu Lixian, Yang Yuan, Mi Kai, Shen Yan, He Zhongshun, Tan Zhenghui, Liu Ying, Yu Jianyun. Application of FIAS based classroom teaching interactive behavior evaluation system in higher medical education [J]. Chinese Journal of Medical Education, 2020, 40(10): 841-844.
[8]	Bao Tingting, Yin Yuan, Lin Haitao, Song Dan. Practice and effect evaluation of training mode for resident standardized training base of tumor radiotherapy specialty [J]. Chinese Journal of Medical Education, 2020, 40(1): 70-73.
[9]	Li Yifeng, Li Niannian, Ye Ren, Zhao Jiayun. Analysis of blind evaluation results of master's degree thesis of clinical medicine in different culture types [J]. Chinese Journal of Medical Education, 2019, 39(9): 696-700.
[10]	Ye Guilian, Gao Guozhen, Chen Hanyu. Qualitative study on the application of formative evaluation in clinical practice of nursing students [J]. Chinese Journal of Medical Education, 2019, 39(12): 922-925.
[11]	Yu Fenfen, Huo Lijun, Su Yihua, Chen Yongchong, Gan Shibin, Wan Pengxia. Comparison of the effects of different standardized training modes for general practitioners in ophthalmology [J]. Chinese Journal of Medical Education, 2019, 39(12): 974-977.
[12]	Ma Liwei, Chen Hao, Wang Weiping, Wang Pu, Wu Xin, Zhang Weifang, Ni Juhua. Application of diversified evaluation methods in biochemistry course [J]. Chinese Journal of Medical Education, 2019, 39(11): 812-816.
[13]	Yu Fangfei, Li Min, He Xiaohua, Xu Nenggui. Application and evaluation of micro-lectures teaching system of rehabilitation medicine [J]. Chinese Journal of Medical Education, 2019, 39(11): 817-821.
[14]	Zhou Yujie, Huang Ahong, Jiang Yan, Qiao Yu, Shen Shanmei, Shen Yan, Mao Kaikai, Yang Li. Evaluation on objective structured clinical examination in residency standardized training graduation examination of internal medicine [J]. Chinese Journal of Medical Education, 2019, 39(11): 880-883.
[15]	Zhao Dianhong, Liu Jie, Zheng Liguang. The study of evaluation index based on post competency for pharmacology teachers in school of stomatology [J]. Chinese Journal of Medical Education, 2019, 39(10): 795-800.