Reliability and validity of the mandarin version of mentor competency assessment

  • Li Yue ,
  • Zhang Dingding ,
  • Tong Yuanren ,
  • Wei Yizhen ,
  • Zhu Huijuan ,
  • Liu Jihai ,
  • Luo Linzhi ,
  • Zhang Shuyang
Expand
  • 1Department of Gastroenterology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing 100730, China;
    2Department of Medical Research Center, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing 100730, China;
    3Eight-year Program of Clinical Medicine, Enrolled in 2014, Peking Union Medical College, Beijing 100730, China;
    4Department of Education, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences, Beijing 100730, China;
    5Department of Endocrinology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing 100730, China;
    6Department of Cardiology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Beijing 100730, China

Received date: 2020-06-23

  Online published: 2021-04-29

Supported by

Education Reform Projects of Peking Union Medical College (2020zlgc0110)

Abstract

Objective To translate the mentor competency assessment (MCA) into Mandarin, and test its reliability and validity. Methods Brislin translation model was used for translation and reverse-translation. The preliminary translation was culturally adjusted through expert committee discussions followed by a pre-tests. Mentors of clinical post-doctoral trainees at Peking Union Medical College Hospital (PUMCH) were enrolled as the survey subjects (n=153) from January 2020 to March 2020. General questionnaire and Mandarin version of MCA were used. Item analysis, reliability, and validity analysis of the Mandarin version of MCA were tested. Results The Mandarin version of MCA includes 26 items in six dimensions, including effective communication, establishing consistent expectations and goals, evaluating students, fostering independence, respecting diversity, and promoting students' professional development. Reliability analysis showed that Cronbach's coefficient score was 0.975, and split-half coefficient score was 0.951. Each item was positively correlated with the total score (r=0.634~0.823). The item content validity index (I-CVI) is 0.6~1.0, and the scale content validity index (S-CVI) was 0.954. The confirmatory factor analysis results showed that the ratio of χ2 degrees of freedom (χ2 /DF) was 1.865, the comparative fit index was 0.925, the Tucker-Lewis index (TLI) =0.914, and the standardized root mean square residual(SRMR)=0.043, and the root mean square error of approximation (RMSEA)=0.085 (95%CI,0.073~0.096,P<0.01). Conclusions The reliability and validity of the Mandarin version of MCA was evaluated and the Mandarin version of MCA is competent to the evaluation of the mentor competency of clinical and translational research mentors in China.

Cite this article

Li Yue , Zhang Dingding , Tong Yuanren , Wei Yizhen , Zhu Huijuan , Liu Jihai , Luo Linzhi , Zhang Shuyang . Reliability and validity of the mandarin version of mentor competency assessment[J]. Chinese Journal of Medical Education, 2021 , 41(5) : 472 -476 . DOI: 10.3760/cma.j.cn115259-20200623-00951

References

[1] 李玥, 魏怡真, 张丁丁, 等. 导师培训项目提升临床和转化医学导师的自信心和技能[J].基础医学与临床,2020,40(6):856-862.
[2]Pfund C, House SC, Asquith P, et al. Training mentors of clinical and translational research scholars: a randomized controlled trial[J]. Acad Med, 2014,89(5):774-782. DOI: 10.1097/ACM.000000
0000000218.
[3] Feldman MD, Arean PA, Marshall SJ, et al. Does mentoring matter: results from a survey of faculty mentees at a large health sciences university[J]. Med Educ Online, 2010,23:15.DOI: 10.3402/meo.v15i0.5063.
[4] Fleming M, House S, Hanson VS, et al. The mentoring competency assessment: validation of a new instrument to evaluate skills of research mentors[J]. Acad Med, 2013,88(7):1002-1008. DOI: 10.1097/ACM.0b013e318295e298.
[5] Michael R Phillips, 赵靖平. 西方量表译本的评价和修订[J].国外医学·精神病学分册,1987(3):135-144.
[6] 苏立, 姚秋会, 徐晓阳, 等. 医学研究生导师胜任力评价指标体系的构建[J].保健医学研究与实践,2015,12(2):81-85.
[7] 林卓清, 王兆品, 沈郁, 等. 基于岗位胜任力的临床医学研究生导师评价体系构建及其应用[J].中国高等医学教育,2019(7):125-126. DOI: 10.3969/j.issn.1002-1701.2019.07.064.
[8] Weber-Main AM, Shanedling J, Kaizer AM, et al. A randomized controlled pilot study of the University of Minnesota mentoring excellence training academy: a hybrid learning approach to research mentor training[J]. J Clin Transl Sci, 2019,3(4):152-164. DOI: 10.1017/cts.2019.368.
Outlines

/