Application of multisource assessment and feedback in medical education

doi:10.3760/cma.j.issn.1673-677X.2019.07.015

Abstract

Abstract: Multisource assessment and feedback (MSAF) is a formative evaluation method based on questionnaire survey, which has been widely used in medical education in recent years. This review discussed MSAF probing in medical education and feasibility analysis emphatically. The basic procedures of incorporating MSAF into medical education evaluation were analyzed in detail. Finally, it pointed out that how to design an objective and comprehensive questionnaire, how to set up a special research team to improve feasibility of MSAF and how to collect an efficient feedback were the main challenges that needed to be studied when MSAF was included in the medical education assessment system.

Key words: Multisource assessment and feedback, Application, Medical education

CLC Number:

R-05

Liu Yuenan, Yang Wenbo, Ye Zhewei, Shao Zengwu, Wang Hong, Yang Cao, Huang Wei. Application of multisource assessment and feedback in medical education[J]. Chinese Journal of Medical Education, 2019, 39(7): 545-549.

References

[1]Kirk LM. Professionalism in medicine: Definitions and considerations for teaching[J]. Proc (Bayl Univ Med Cent), 2007,20(1):13-16.
[2]Rodgers KG, Manifold C. 360-degree feedback: Possibilities for assessment of the ACGME core competencies for emergency medicine residents [J]. Acad Emerg Med, 2002,9(11):1300-1304. DOI: 10.1111/j.1553-2712.2002.tb01591.x.
[3]Brinkman WB, Geraghty SR, Lanphear BP, et al. Effect of multisource feedback on resident communication skills and professionalism: A randomized controlled trial[J]. Arch Pediatr Adolesc Med, 2007,161(1):44-49. DOI: 10.1001/archpedi.161.1.44.
[4]刘永中,金才兵. 英汉人力资源管理核心词汇手册[M]. 广州:广东经济出版社,2005:2-4.
[5]陈社育,余嘉元. 经典真分数理论与概化理论信度观评析[J]. 心理学动态,2001,9(3): 258-263.
[6]Edwards MR, Ewen AJ. 360 degrees feedback: The powerful new model for employee assessment and performance improvement[J]. Pers Psychol, 1997,50(2):497-500.
[7]Violato C, Lockyer J, Fidler H. Multisource feedback: A method of assessing surgical practice [J]. BMJ, 2003,326(7388):546-548. DOI: 10.1136/bmj.326.7388.546.
[8]韩蔚. 360度绩效反馈法在护士长考评中的效用分析[J]. 中华护理杂志,2005,40(10): 727-729.
[9]朱晓红,陈丹丹,张艳. 病房护士绩效考核指标的研究[J]. 中国护理管理,2012,12(2): 52-54.
[10]Southgate L, Hays RB, Norcini J, et al. Setting performance standards for medical practice: A theoretical framework[J]. Med Educ, 2001,35(5):474-481.
[11]Violato C, Marini A, Toews J, et al. Feasibility and psychometric properties of using peers, consulting physicians, co-workers, and patients to assess physicians[J]. Acad Med, 1997,72(10 Suppl 1):S82-84.
[12]Hall W, Violato C, Lewkonia R, et al. Assessment of physician performance in Alberta: The physician achievement review [J]. CMAJ, 1999,161(1):52-57.
[13]Norton PG, Dunn EV, Beckett R, et al. Long-term follow-up in the peer assessment program for nonspecialist physicians in Ontario, Canada[J]. Jt Comm J Qual Improv, 1998,24(6):334-341.
[14]Hearnshaw H, Baker R, Cooper A, et al. The costs and benefits of asking patients for their opinions about general practice [J]. Fam Pract, 1996,13(1):52-58.
[15]Mueller PS. Teaching and assessing professionalism in medical learners and practicing physicians[J]. Rambam Maimonides Med J, 2015,6(2):e0011. DOI: 10.5041/RMMJ.10195.
[16]Lockyer J. Multisource feedback in the assessment of physician competencies[J]. J Contin Educ Health Prof, 2003,23(1):4-12. DOI: 10.1002/chp.1340230103.
[17]任汝静, 王刚, 许恩, 等. 360度评价法在实习医师职业道德和沟通能力评价中应用的研究[J].中华医学教育探索杂志, 2014,13(7):728-731. DOI: 10.3760/cma.j.issn.2095-1485.2014.07.021.
[18]黄彩红. 360度考核法在产房助产士实习生带教中的应用体会[J]. 广西医学,2007,29(3):459-460.
[19]胡笑甜, 倪俊学, 姚小康, 等. 360度反馈评价法在实习医生临床沟通能力评价中的应用[J].中国高等医学教育, 2014(1):74,104. DOI: 10.3969/j.issn.1002-1701.2014.01.039.
[20]吕力, 张毅萍, 王进进, 等. 360度反馈评价在医学教育临床教学中的运用[J].中国高等医学教育, 2007(11):52-53,69.
[21]Ferguson J, Wakeling J, Bowie P. Factors influencing the effectiveness of multisource feedback in improving the professional practice of medical doctors: A systematic review[J]. BMC Med Educ, 2014,14:76. DOI: 10.1186/1472-6920-14-76.
[22]Donnon T, Al Ansari A, Al Alawi S, et al. The reliability, validity, and feasibility of multisource feedback physician assessment: A systematic review [J]. Acad Med, 2014,89(3):511-516. DOI: 10.1097/ACM.0000000000000147.
[23]曲波,郭海强,张阳,等. 住院医师职业道德和交流沟通能力的360度评价研究[J]. 中国高等医学教育,2010(6): 6-7,10.
[24]Ramsey PG, Carline JD, Blank LL, et al. Feasibility of hospital-based use of peer ratings to evaluate the performances of practicing physicians [J]. Acad Med, 1996,71(4):364-370.
[25]Sargeant J, Mann K, Sinclair D, et al. Challenges in multisource feedback: Intended and unintended outcomes [J]. Med Educ, 2007,41(6):583-591. DOI: 10.1111/j.1365-2923.2007.02769.x.
[26]Sargeant JM, Mann KV, Ferrier SN, et al. Responses of rural family physicians and their colleague and coworker raters to a multi-source feedback process: A pilot study [J].Acad Med, 2003,78(10suppl):S42-44.
[27]张健,吴华章. 医师考核360度评价法的可靠性、有效性及可行性的系统研究[J]. 中国继续医学教育,2016,8(3):1-3. DOI: 10.3969/j.issn.1674-9308.2016.03.001.
[28]Massagli TL, Carline JD. Reliability of a 360-degree evaluation to assess resident competence [J]. Am J Phys Med Rehab, 2007,86(10):845-852. DOI: 10.1097/PHM.0b013e318151ff5a.
[29]乔梁,王亚军. 多源评估反馈在住院医师规范化培训中的应用[J]. 中华医学教育杂志,2017,37(3):462-464,473. DOI: 10.3760/cma.j.issn.1673-677X.2017.03.032.