Abstract: Objective To analyzes scoring accuracy of clinical thinking ability assessment in the empirical study of National Medical Licensing Examination(NMLE) phased examination, so as to provide reference for the follow-up study of CTA system. Methods In 2018,a simple random sampling method was used to select 35 candidates who participated in the CTA test as the research object. Eight clinical doctors of position of senior or higher from the third class hospital were invited as clinical experts to evaluate the clinical thinking ability of 35 examinees, then the consistency between CTA system score and clinical expert grade evaluation is analyzed by the Pearson correlation coefficient and general theory (GT). Results Pearsonal correlation coefficient of CTA system and clinical expert rating in information collection, disease analysis, clinical diagnosis and treatment and dynamic decision making were 0.824, 0.697, 0.856 and 0.815; The generalizability coefficient of GT analysis were 0.879, 0.904, 0.879, 0.878, dependent index were 0.674, 0.863, 0.869, 0.797. Conclusions The evaluation system of CTA is consistent with clinical experts evaluation.

Key words: Clinical thinking ability assessment, National Medical Licensing Examination, Generalizability theory, Generalizability coefficient, Dependent index