17.09 Does ACS-ERRA Predict New Residents’ Performance in ABSITE?

N. Chilukuri1, S. Shebrain1  1Western Michigan University, General Surgery, Kalamazoo, MICHIGAN, USA

Background:

The American College of Surgeons Entering Resident Readiness Assessment (ACS ERRA) Program is a case-based designed instrument intended to measure the preparedness of new trainees upon entering surgical residency. The assessment focuses on clinical decision-making for cases frequently encountered at the beginning of resident training. The ACS ERRA provides surgery program directors and residents with measures of key skills needed to safely assume their new clinical responsibilities. This study aims to evaluate the correlation between ERRA and the United States Medical Licensing Examination® (USMLE®) scores, and also the American Board of Surgery In-Training Examination (ABSITE) at postgraduate year 1.

 

Methods and Materials:

All new interns entering in PGY1 at a general surgery residency program in a single institution over 6 years were included in the study. ACS ERRA raw scores were compared to USMLE Step 1 and Step 2 scores, and ABSITE raw and standard scores.

 

Results:

A total of 26 new residents, of which 18 (69.2%) were male, took ACS ERRA in July of their PGY1 year. The mean (SD) for USMLE-1, USMLE-2 scores was 243.23 ± 8.00 and 251.00 ± 10.21, respectively. The mean (SD) for ABSITE raw score and standard scores was 61.30 ± 6.80 and 431.10 ± 62.50, respectively. The mean (SD) for ACS ERRA total points and raw scores was 26.91 ± 2.00 and 67.30 ± 5.03, respectively. There was a moderate but statistically significant correlation between ACS ERRA and USMLE Step 2 (r=.44, p=.038). Small to negligible correlation was observed between ACS ERRA and ABSITE raw scores (r=.12, p=.62), ABSITE standard scores (r=.13, p=.60), and USMLE Step 1 scores (r=.04, p=.86).

 

Conclusion:

The positive correlation between ACS ERRA scores and USMLE Step 2 scores provides valuable information about clinical importance of USMLE-2 for residents entering surgery. However, the effect of ERRA on ABSITE at PGY1 is weak. Further large study is recommended.