Objective To explore the application effect of formative assessment combined with medical vision world examination system in improving the quality of standardized residents training. Methods Self-control method was used in this study. Totally 17 residents who received standardized training in otolaryngology training base institute in the Second Affiliated Hospital of Dalian Medical University from July to November 2019 were selected as the research objects, including 10 trainees who started training in 2017 (group A) and 7 trainees who started training in 2018 (group B). The formative assessment combined with medical vision world examination system was used to strengthen the training and daily assessment every week. A total of 14 rounds of assessments were conducted. The training effect was evaluated by examination results and questionnaire survey. Repeated measurement ANOVA was used to study the influence of different training times and groups on daily examination results. Results There was no statistically significant difference in the average score of group A(133.49±13.81) and group B (131.89 ± 12.26) (P>0.05); There was statistically significant difference in the overall assessment results of different training times when other factors are not considered (P<0.01); With the increase of training times, the influence of groups on assessment results was not statistically significant (P>0.05); After three training, the results improved significantly and gradually stabilized. The results of satisfaction survey showed that all 17 students were very satisfied with following issues as the mastery of otolaryngology knowledge, the improvement of medical record documentation, completion of residential training, pass of examinations, skill of communication with their supervisors, and 17 students were very satisfied with the teaching and teachers. Conclusions Formative evaluation combined with medical vision world examination system is helpful to improve the assessment results of otolaryngology resident trainees and optimize the outcomes of training, it is suitable for trainees at different training stages, so it is well acknowledge by trainees at different stages.