Evaluating an APPE Assessment Tool Using Electronic Surveys to Assess Preceptor Attitudes and Implementing Improvements to More Accurately Measure Student Achievement

Abstract

Objectives: (1) To assess preceptors’ attitudes regarding the usefulness of the web-based assessments in evaluating rotation students. (2) To determine which assessment tool (original versus modified) provides more in-depth feedback for the evaluation of students. Subjects: Preceptors for 4th year students completing their Advanced Pharmacy Practice Experiences (APPE) in a variety of pharmacy settings. Methods: Electronic surveys anonymously collected ratings of preceptor attitudes toward the original and modified APPE assessment tools. Data on the usefulness, strengths, and limitations of both tools were analyzed through thematic analysis. Results: Surveys assessing preceptor attitudes towards the original assessment tool (46 responses) and modified assessment tool (29 responses) were collected and analyzed. Similar representation was seen across all rotation settings, with an average of 7 years of precepting experience. Preceptor attitudes were more positive towards the modified tool. More preceptors “strongly agreed” or “agreed” that they were able to effectively evaluate students with the modified tool compared to the original tool (83% vs. 63%). Additionally, more preceptors “strongly agreed” or “agreed” that the modified tool incorporated all necessary competencies (79% vs. 48%) and aided student growth by addressing deficits compared to the original tool (73% vs. 50%). Conclusions: APPE preceptors perceived both the original and modified assessment tools as effective, favoring their brevity and ease of use. However, preceptor attitudes were more positive towards the modified tool. The methods utilized in this study can be implemented again for future updates of the APPE assessment tool.