WIP 43 - Establishing Evidence of Validity for a Novel Pediatric Airway Management Assessment Tool in Pediatric Trainees

Publication Number: WIP 43.7432

Rebecca J. Martin, Arkansas Children's Hospital, Little Rock, AR, United States; Ron Sanders, University of Arkansas for Medical Sciences College of Medicine, Little Rock, AR, United States; Stephen N. Epps, University of Arkansas for Medical Sciences, Little Rock, AR, United States; Michael Anders, University of Arkansas for Medical Sciences College of Medicine, Little Rock, AR, United States; Corey Nagel, University of Arkansas for Medical Sciences, Little Rock, AR, United States; Patrick R. Ayers, University of Arkansas for Medical Sciences College of Medicine, LITTLE ROCK, AR, United States; Chinyere Egbuta, Harvard Medical School, Boston, MA, United States; Akira Nishisaki, Childrens Hospital of Philadelphia, Philadelphia, PA, United States

Background: Airway management is a core skill for pediatric critical care medicine (PCCM) and pediatric emergency medicine (PEM) physicians. Intubation in critically ill pediatric patients is high-risk – severe adverse events occur in 6.5% of patients. Adverse events occur more often when airway management is performed by those with less experience. The American Board of Pediatrics, Accreditation Council for Graduate Medical Education have established standards for pediatric subspecialty fellows using entrustable professional activities, competencies, milestones. However, these are not specific to airway management. Previously, we used modified Delphi methods to define competency measures for pediatric subspecialty trainees in airway management. These standards were used to develop Pediatric Airway Skills Tool (PediAir Skills), a novel assessment tool using behaviorally anchored rating scales.

Objective: We hypothesize that use of PediAir Skills will differentiate between novice, expert skills in airway management in simulations.

Design/Methods: With local IRB approval, we invited pediatric residents, PCCM/PEM fellows, and PCCM/PEM faculty to participate in simulations. Demographic information about previous airway experience is collected. Each participant will complete 3 airway-focused simulations of varying difficulty that are recorded and reviewed by 2 study team members using PediAir Skills. Reviewers completed rater training. We will calculate descriptive statistics, determine inter-rater reliability and conduct regression analysis to evaluate the association of PediAir Skills scores with key factors of interest. Generalizability theory will be used to evaluate factors contributing to measurement error, variance. Simulations occur in October-November 2024. Review of simulations occurs November 2024-February 2025. Data analysis occurs February 2025. All results will be complete by April 2025.

Preliminary

Results: We enrolled 22 participants: 7 pediatric residents, 4 PCCM fellows, 5 PEM fellows, 5 PCCM faculty, 2 PEM faculty. 33 simulations are completed.