170 - Effectiveness of Sequential Simulation-Based Training on Pediatric Resident Performance: A 7-Month Prospective Study

Publication Number: 170.4761

Zoha Nizami, University of South Alabama Children's and Women's Hospital, Mobile, AL, United States; Reshvinder Dhillon, University of south Alabama, Mobile, AL, United States

Background: Simulation-based medical education (SBME) is increasingly utilized in pediatric residency training, showing improved clinical competency and patient outcomes.

Objective: This study aimed to evaluate the effectiveness of repeated simulation sessions on resident confidence and performance over a 7-month period.

Design/Methods: A prospective observational study was conducted involving pediatric residents participating in monthly simulation sessions, following established frameworks for simulation-based education. Two 30-minute simulation sessions were conducted back-to-back each month, with 5 residents per session. The study was divided into Phase 1 (months 1-3) with non-repeated residents and Phase 2 (months 4-7) with repeated resident participation. Confidence was evaluated using pre and post-simulation surveys and the group's performance was assessed using standardized pass/fail criteria.

Results: Statistical analysis revealed a significant increase in residents' confidence levels and average performance between Phase 1 and Phase 2. An independent t-test demonstrated a significant increase in residents' confidence levels between Phase 1 and Phase 2, with p < 0.001 in the pre-survey and p < 0.05 in the post-survey. Chi-square analysis examining the association between repeated resident participation and Pass rate between Phase 1 and 2 indicated a significant association between the variables, with χ2 (1, N=70) = 21.91, p < 0.001. A strong positive correlation was also observed in monthly average performance scores over the 7 months (Pearson's r = 0.948, p < 0.015), indicating a consistent upward trend in resident competency. The line fit plot demonstrates a positive linear relationship between time and performance scores, with baseline scores around 55% improving to approximately 80% by the study conclusion.

Conclusion(s): Sequential simulation-based training shows significant effectiveness in improving pediatric resident performance over time. The strong correlation between session repetition and performance improvement suggests that regular, structured simulation training may be an effective tool for enhancing resident competency. These findings support the integration of recurring simulation sessions into pediatric residency training programs. It is important to note that not all residents in each group were repeated in the second phase. However, the difference in the performance of the group in phase two shows that the repetition of the simulation for even one team member can significantly impact the performance of the whole group.

Correlation of residents' performance over time
Strong positive correlation is noted between average residents' performance scores over time with r=0.94 with a p-value of <0.01

Confidence level of residents pre and post simulation in Phase 1 vs. Phase 2
Significant increase in residents' confidence levels between Phase 1 and Phase 2 is noted with p < 0.001 in the pre-survey and p < 0.05 in the post-survey. Likert Scale ranging from 1 (Very Unconfident) to 5 (Very Confident) used to assess confidence