Abstract: Objective To evaluate the application of the smart management system of educational tutors in residency standardized training (RST). Methods A questionnaire survey method was used from November 2019 to August 2022, a total of 229 RST educational tutors(72), RST managers(65), residents(92) in Shanghai East Hospital, Tongji University were selected as the survey subjects, and a self-designed questionnaire was used to investigate their use of the educational tutor's smart management system (management system for short). The data were analyzed by chi-square test and analysis of variance test. Results The level of the management system by RST tutors, RST managers and residents in ease of use was [70(97.2%) vs. 63(96.9%) vs. 90(97.8%), P=0.398], and satisfaction was [72 (100.0%) vs. 65 (100.0%) vs. 92 (100.0%), P=0.453], the differences were not statistically significant. In the evaluation of the overall advantages of the management system by RST tutors, RST managers and residents, paperless management can save cost [(91.24±12.89) vs. (90.98±12.75) vs. (87.92±16.61), P=0.263], clear processes for full management [(88.14±12.65) vs. (87.80±13.16) vs. (84.15±17.16), P=0.158], simplicity of operation improving management efficiency [(88.49±12.67) vs. (86.20±13.11) vs. (84.61±16.93) P=0.245], and automatic matching of teacher and student satisfaction [(87.13±12.24) vs. (87.06±11.69) vs. (88.04±16.52), P=0.881], the differences were not statistically significant. After the establishment of the management system, the 2022 residents (81) completed the comprehensive examination pass rate [78 (96.3%) vs. 57 (87.7%), P=0.049] and the department examination results [(91.58±5.72) vs. (90.90 ±10.60), P=0.045] were higher than those in 2019 (65) before the establishment of the management system. In the annual assessment from August 2021 to August 2022, 71 (98.6%) tutors completed monthly interviews with residents. Conclusions The management system is highly appreciated and unanimously recognized by users, the system has certain advantages in terms of cost savings, management efficiency improving and automatically matching teachers and students. The management system is helpful to improve the qualification rate of the comprehensive examination of the residents and the examination results after graduation at Shanghai East Hospital, and to improve the efficiency of RST management of residential training and the quality of training.

Key words: Management information systems, Artificial intelligence, Educational tutor, Residency standardized training, Residents