Evaluating Design Improvements to a Preceptor Performance and APPE Assessment Tool Using Pharmacy Student Focus Groups

Abstract

Specific Aims: The final year of the Doctor of Pharmacy program at the University of Arizona is comprised of seven 6-week Advanced Pharmacy Practice Experiences (APPEs). Students evaluate rotations via voluntary anonymous, web-based assessments at the end of each rotation. The purpose of this study was to evaluate an original and a modified assessment tool using pharmacy student focus groups to determine if student feedback via the assessment tools accurately reflected opinions of rotation content and preceptor performance. Methods: Two moderators conducted tape-recorded focus groups with fourth-year pharmacy students using 10 standardized prompts. The first focus group included 5 students from the class of 2013. Based on data from that session, the assessment tool was modified. The second focus group included 5 students from the class of 2014 to evaluate the outcome of these modifications. Session transcripts and notes were used to construct thematic analysis tables and draw conclusions. Main Results: Focus group data revealed feedback via both assessment tools was not completely honest because of concerns about anonymity. The Class of 2013 felt limited by evaluating only their primary preceptor. The Class of 2014 stated that some revisions to the evaluation tool, such as item-specific comment boxes and separate evaluative sections for rotation site, preceptor, and rotation experience were helpful; however, they found the assessment tool lengthy, leading to survey fatigue. Conclusion: Student feedback from either assessment tool was not completely reflective of true attitudes of rotation experiences. Continued improvements to the tool and its delivery may provide more accurate feedback for quality improvement purposes.