Analysis for the influencing factors of item difficult in China's National Medical Licensing Examination

doi:10.3760/cma.j.issn.1673-677X.2017.02.034

Abstract

Abstract: In this paper, an analysis was presented based on ordinal logistic regression that illustrates what is the relationship between “expert judges”(or student) and influencing factors of item difficulty. The results of the study show that test purpose and cognitive skills primarily influence “expert judges”. However, the patterns shown by the student data are effectiveness of the incorrect alternative responses, connective between current practice and test content, negative questions mostly influence students. Although work from this study is limited, it suggests that the prediction item difficulty will fare well when relevant studies are conducted.

Key words: National medical licensing examination, Item difficulty, Influencing factors, Analysis

Yang Fangli, He Jia. Analysis for the influencing factors of item difficult in China's National Medical Licensing Examination[J]. Chinese Journal of Medical Education, 2017, 37(2): 312-316.

References

[1] 何惧,何佳,张赛一,等.医师资格考试内容效度的质量控制措施[J].高校医学教学研究(电子版),2015,5(1):54-57.
He J, He J, Zhang SY, et al. Introduction of quality control measures to improve the content validity of National Medical Licensing Examination[J].Medical Teaching in University (Electronic Edition),2015,5(1):54-57.
[2] 董圣鸿,漆书青,戴海崎,等.题目难度、区分度参数人工赋值方法的研究[J].考试研究, 2005(1):25-32,24.
[3] 柳博.预估难度一种自学考试的试题难度确定方法[J].中国考试(研究版),2007(7): 29-34.
[4] 杨涛,辛涛,杨婷婷.试题难度的主观预估方法[J].中国考试,2014(2):3-9.
Yang T, Xin T, Yang TT. Subjective prediction methods of item difficulty estimation[J].China Examinations,2014(2):3-9.
[5] 毛竞飞.高考命题中试题难度预测方法探索[J].教育科学,2008,24(6):22-26.
Mao JF. Research on predictive methods of item difficulty in the college entrance of examination[J]. Education Science,2008,24(6):22-26.
[6] Kleinbaum DG, Klein M.Logistic regression: a self-learning text[M].3rd ed.New York:Springer Publishers,2010:168-193.
[7] 田霖,王桥影.自学考试的试题难度赋值方法述评[J].中国考试,2010(4):24-30.
Tian L, Wang QY. Item difficulty evaluation's advances in self-taught examination[J].China Examinations,2010(4):24-30.
[8] 王晓华.论高等教育自学考试试题难度的控制[J].中国考试(研究版),2008(1):48-54.
Wang XH. The discussion on the item difficulty control of the higher education self-taught examination[J].China Examination,2008(1):48-54.
[9] Lorge I, Kruglov L. A suggested technique for the improvement of difficulty prediction of test items[J].Educational and Psychological Measurement,1952, 12(4):554-561.
[10] Bejar II, Embretson S, Mayer RE. Cognitive psychology and the SAT:a review of some implications[R/OL].[2017-01-10].http://www.ets.org/research/policy_research_reports/publications/report/1987/hwpo.
[11] Quereshi MY, Fisher TL. Logical versus empirical estimates of item difficulty[J].Educational and Psychological Measurement,1977,37(1):91-100.

[1]	Zhou Jianping, Shao Jie, Li Qingyun. The practice and analysis of outstanding traditional culture of clinical departments in occupational spirit education for medical undergraduates [J]. Chinese Journal of Medical Education, 2020, 40(9): 671-674.
[2]	Ge Wenjia, Wei Jing, Xu Wanfei, Ren Ruimin. Investigation and analysis of mental health relevant factors of medical graduates of various grades in a university [J]. Chinese Journal of Medical Education, 2020, 40(8): 582-585.
[3]	Li Guojian, Xiang Yang, He Ju, Liu Maowei, Han Chunmei, Xi Zheng, Zhang Dongqi. Framework construction and system design of clinical thinking ability assessment [J]. Chinese Journal of Medical Education, 2020, 40(7): 565-568.
[4]	Guo Feifei, Bai Ling, Liang Tingting, Li Wei, Cui Jiuwei. Present situation analysis and improvement strategy of oncology teaching for medical undergraduates [J]. Chinese Journal of Medical Education, 2020, 40(6): 417-420.
[5]	Wang Chenglong, Wu Hongjin, Zhang Jie, Wang Libo, Dai Weiwei. Analysis on the effect of experimental skills training for research of academic graduate students of traditional Chinese medicine [J]. Chinese Journal of Medical Education, 2020, 40(5): 372-376.
[6]	Zhang Wenjuan, Zhang Saiyi, Wang Haifeng, Ding Yimin, Wen Jiyuan, Xuan Haihua. The exploration and research of management information construction of practical skills examination in ChineseNational Medical Licensing Examination [J]. Chinese Journal of Medical Education, 2020, 40(5): 387-391.
[7]	Lu Yan, Li Guojian, He Ju, Zhang Ying. Analysis of scoring accuracy of clinical thinking ability assessment [J]. Chinese Journal of Medical Education, 2020, 40(5): 392-396.
[8]	Hao Jingjing, Hao Hongjun, Li Jie, Gu Junchao. A study on the status and correlation of professional commitment and career maturity of medical English major students [J]. Chinese Journal of Medical Education, 2020, 40(4): 274-278.
[9]	Lu Yan, Zhang Ying, He Ju, Zou Jiewen. The application of many facets Rasch model in the first stage clinical fundamental skills test of National Medical Licensing Examination phased examination [J]. Chinese Journal of Medical Education, 2020, 40(4): 311-315.
[10]	Zhang Chi, Li Xin, Jia Jinzhong, Huang Tianren, Liu Deping. Construction and reliability and validity analysis of satisfaction scale for medical graduates [J]. Chinese Journal of Medical Education, 2020, 40(4): 316-320.
[11]	Ma Ruixin, Xu Wendi, Wu Zehua, Wang Fei, Xu Xiaofeng, Wang Chao. Research of psychological health factors among residents in affiliated hospital during the COVID-19 pandemic [J]. Chinese Journal of Medical Education, 2020, 40(11): 888-892.
[12]	Sun Pengxia, Li Shuya, Li Fan. Investigation of medical students' readiness for the trans-discipline learning [J]. Chinese Journal of Medical Education, 2020, 40(11): 901-904.
[13]	Lyu Jing, Mu Lixian, Yang Yuan, Mi Kai, Shen Yan, He Zhongshun, Tan Zhenghui, Liu Ying, Yu Jianyun. Application of FIAS based classroom teaching interactive behavior evaluation system in higher medical education [J]. Chinese Journal of Medical Education, 2020, 40(10): 841-844.
[14]	Li Yifeng, Li Niannian, Ye Ren, Zhao Jiayun. Analysis of blind evaluation results of master's degree thesis of clinical medicine in different culture types [J]. Chinese Journal of Medical Education, 2019, 39(9): 696-700.
[15]	Wang Zhuoyun, Wang Jing, Zhu Lei, Wang Xiuyan. A survey of residents' attitude, ability and influencing factors of communication with patients [J]. Chinese Journal of Medical Education, 2019, 39(2): 105-111.