Objective To explore the status of standardized residency training in Zhongnan Hospital of Wuhan University with competency-based medical education evaluation system, and to provide suggestions for improving the competency of residents. Methods In 2022, a questionnaire survey was conducted to evaluate the job competency of 185 resident physicians from the 2021 cohort, both at the time of admission and after six months of training. Both self-evaluations and evaluations by tutors were collected. Paired-sample t-tests and one-way ANOVA analysis were performed on the evaluation results. Results After six months of training, both the self-evaluation of the residents and the evaluations by their tutors showed significant improvement compared to their initial admission. For example, in terms of professionalism, the self-evaluation score of the residents increased to (4.31±0.76), higher than the initial score of (3.87±0.95); the evaluation score by tutors was (4.70±0.50), also higher than the initial score of (4.54±0.65), all P<0.001. After six months of training, the self-evaluation score for professionalism among residents was the highest [(4.31±0.76)], while the self-evaluation score for the healthcare system was the lowest [(3.15±1.07)]. Furthermore, after six months of training, there were no statistically significant differences in the self-evaluation results of job competency among resident physicians of different identities (all P>0.05). For instance, the self-evaluation scores for professionalism among residents recruited from society, those under the entrusted training of other institutions, professional master in clinical medicine, and residents within the same institution were (4.30±0.75), (4.28±0.80), (4.29±0.77), and (4.46±0.71), respectively. Conclusions Standardized residency training can improve the competency of residents. But at the same time, the weakness of medical quality assurance system, patient management and academic performance should be strengthened. Therefore, supervision, peer, patient evaluation and assessment results will be increased in the later stage to achieve a comprehensive evaluation and analysis of the residents and improve the residents competency.