Evaluation of resident performance in an outpatient internal medicine clinic using standardized patients

Abstract

Objective: To observe and evaluate the performance of primary care internal medicine residents within the outpatient clinic milieu.

Design: Longitudinal descriptive study.

Patients/participants: 48 internal medicine resident encounters with two standardized patients at the University of Wisconsin General Internal Medicine Clinics.

Intervention: Residents were rated by the standardized patients with a medical skills checklist and an interpersonal skills checklist, and by the staffing physician with a clinical reasoning skills checklist. The investigators reviewed audiotapes of the standardized patient encounters for strategic management skills.

Main results: Resident performance on these scales was examined for improvement with years of training; when considered separately, no such effect was seen for either standardized patient case. When the cases were grouped together, however, there was significant improvement on the Clinical Reasoning Instrument. The grouped standardized patient data were compared with data from inpatient faculty evaluations of the residents. Faculty evaluations correlated with standardized patient evaluations of resident performance only on the medical checklist. Finally, comparison of the four assessment scales demonstrated a significant correlation between interpersonal skills, as assessed by the patient, and strategic management skills.

Conclusion: Resident outpatient performance, measured in a blinded setting, does not improve with year of training. Faculty inpatient assessments of residents correlate with medical “thoroughness” as measured by a medical skills checklist, and interpersonal skills as rated by standardized patients correlate with resident use of strategic medical management.