A comparative analysis of the scores by self-assessment and by the examiners of anesthetic standardized resident training final examination in Beijing

  • Huo Fei ,
  • Ju Hui ,
  • Feng Yi ,
  • Chang Lianfang
Expand
  • 1Department of Anesthesiology, Peking University People's Hospital, Beijing 100044, China;
    2Beijing Health Human Resources Development Center, Beijing 100034, China

Received date: 2023-03-31

  Online published: 2024-05-30

Abstract

Objective To compare the scores of a video-based surgical assessment by the examiners and the examinees to find out pitfalls in the process of standardized resident training in anesthesia. Methods Using a full sample survey method, a questionnaire survey was conducted on 193 resident anesthesiologists who participated in the Beijing residency training clinical practice ability graduation assessment in June 2022, along with its operation assessment video and assessment results as the data source to act as the candidates' clinical practice ability assessment results. The self-evaluation of the candidates was obtained. Student t-test or paired t-test was used for data analysis. Results There were no obvious differences between the scores by examinees or by examiners in the assessment of spinal anesthesia[(28.39±1.32)vs.(28.26±1.32),P=0.317].In arterial catheterization, endotracheal intubation, central venous catheterization and electric defibrillation, the scores by the examinees were significantly higher than those by the examiners [(28.99±1.32) vs. (27.95±1.33), (29.06±1.30) vs. (28.28±1.29), (29.07±1.30) vs. (28.37±1.35), (59.44±1.95) vs. (57.78±1.42), all P<0.05]. The scores by the examinees were significantly higher than those by the examiners in area related to the procedure protocols, aseptic principles, simulator-related items, and non-technical skills[for example, position and fixation of the endotracheal tube: (1.93±0.19) vs. (1.75±0.29), the sterility principle during spinal anesthesia: (1.98±0.13) vs. (1.86±0.27), the recognition of the central venous canal, the cleaning of the skin of patient: (2.94±0.24) vs. (2.66±0.70), the electrode plate during the electric defibrillation: (1.85±0.33)vs.(0.98±0.94), all P<0.05 ]. Conclusions There is a deviation in self-perception of arterial catheterization, endotracheal intubation, central venous catheterization, cardiopulmonary resuscitation and electrical defibrillation in resident anesthesiologists. In the skill training, residents should strengthen the study of clinical operation norms and aseptic principles, and strengthen the cultivation of their non-operational skills.

Cite this article

Huo Fei , Ju Hui , Feng Yi , Chang Lianfang . A comparative analysis of the scores by self-assessment and by the examiners of anesthetic standardized resident training final examination in Beijing[J]. Chinese Journal of Medical Education, 2024 , 44(6) : 467 -470 . DOI: 10.3760/cma.j.cn115259-20230331-00344

References

[1] Feinsilber D, Siripala DS, Mears KA. Review of cognitive biases in ACGME milestones training assessments in post-graduate medical education programs[J]. Cureus, 2019,11(8):e5518. DOI: 10.7759/cureus.5518.
[2] Han MH, Park SG. Differences between scores assessed by examiners and examinees on objective structured clinical examination[J].Korean J Med Educ,2009,21(3):279-285. DOI: 10.3946/kjme.2009.21.3.279.
[3] Tang Z, Shikama Y, Otani K. Comparison of student self-assessment and teacher assessment of medical interview performance during bedside learning[J].Fukushima J Med Sci,2023,69(1):21-28. DOI: 10.5387/fms.2023-03.
[4] 鞠辉, 汤峙瑜, 韩侨宇, 等. 北京市住院医师规范化培训麻醉科指导医师现况调查[J].中华医学教育杂志,2022,42(6):554-557. DOI: 10.3760/cma.j.cn115259-20211203-01482.
[5] Langton H. The management of central venous catheters and infection control: is it time to change our approach?[J].J Perioper Pract,2014,24(6):141-146. DOI: 10.1177/175045891402400603.
[6] Friedman Z, Siddiqui N, Katznelson R,et al.Experience is not enough: repeated breaches in epidural anesthesia aseptic technique by novice operators despite improved skill.[J].Anesthesiology, 2008, 108(5):914-920.DOI:10.1097/ALN.0b013e31816bbdb6.
[7] Yeates P, Moult A, Lefroy J, et al. Understanding and developing procedures for video-based assessment in medical education[J].Med Teach,2020,42(11):1250-1260. DOI: 10.1080/0142159X.2020.1801997.
[8] Radhakrishnan B, Katikar MD, Myatra SN, et al. Importance of non-technical skills in anaesthesia education[J].Indian J Anaesth,2022,66(1):64-69. DOI: 10.4103/ija.ija_1097_21.
[9] Flin R, Patey R, Glavin R,et al.Anaesthetists' non-technical skills [J].British Journal of Anaesthesia,2010,105(1):38-44.DOI: 10.1093/bja/aeq134.
Outlines

/