Smartphone-based app for evaluating cardiothoracic residents: Feasibility and engagement

Purpose: Timely and high-quality feedback is important in cardiothoracic (CT) surgery education. Feedback on operative proficiency is an area for improvement in CT surgery programs. Traditional evaluations significantly lag behind operative interactions. We hypothesized that use of the System for Improving and Measuring Procedural Learning (SIMPL) app would improve operative feedback for trainees.

Methods: Use of SIMPL was evaluated from December 2018 to January, 2021 within an academic CT surgery training program. Ratings include level of supervision, complexity of the operation, and trainee performance. Completion was limited to 72 h after the operation. Descriptive statistics of the users and ratings are presented.

Results: Over 28 months, 816 evaluations were completed, and of these, 495 had a rating from both the faculty and trainee. There were 19 trainees representing post-graduate years 1-8 and 19 faculty members who received or submitted at least one evaluation over the study period. The number of evaluations for each trainee ranged from 1 to 166 and from 1 to 81 for each of the faculty. The response rate for faculty ranged from 0% to 100%. "Active help" was the most common type of supervision (50.7% by the faculty, 60.4% from the trainees).

Conclusions: Use of SIMPL within a CT surgery training program was feasible and engagement was observed from both trainees and faculty. SIMPL provided trainees with timely, concise feedback on operative performance. Further work will focus on correlating SIMPL ratings with pre-existing assessments of performance.