Revisiting the Utility of Retrospective Pre-Post Designs: The Need for Mixed-Method Pilot Data
Author
Geldhof, G. JohnWarner, Danielle A.
Finders, Jennifer K.
Thogmartin, Asia A.
Clark, Adam M.
Longway, Kelly A.
Affiliation
Oregon State UniversityThe University of Arizona
Issue Date
2018-10
Metadata
Show full item recordPublisher
ElsevierCitation
Geldhof, G. J., Warner, D. A., Finders, J. K., Thogmartin, A. A., Clark, A., Longway, K. A. (2018). Revisiting the utility of retrospective pre-post designs: The need for mixed-method pilot data.Journal
Evaluation and Program PlanningRights
© 2018 Elsevier Ltd. All rights reserved.Collection Information
This item from the UA Faculty Publications collection is made available by the University of Arizona with support from the University of Arizona Libraries. If you have questions, please contact us at repository@u.library.arizona.edu.Abstract
The retrospective pre-post design affords many benefits to program staff and, accordingly, has piqued renewed interest among applied program evaluators. In particular, the field has witnessed increasing application of a post-program-only data collection strategy in which only posttest and retrospective pretest data are collected. A post-program-only assessment strategy takes considerably less time than is required for collecting pre-program data and presumably has the added benefit of eliminating the impact of response-shift bias. Response-shift bias occurs when the knowledge, skills, or experiences participants gain through program participation leads them to interpret questionnaire items in a qualitatively different manner at pretest versus posttest. In this article, we discuss the strengths and weaknesses associated with administering retrospective pretest assessments and underscore the importance of thoroughly evaluating any application of a retrospective measurement strategy prior to its broader implementation. We provide a practical illustration of this evaluation process using a mixed-method study that assesses one measure of parenting education program effectiveness—the Parenting Skills Ladder.Note
24 month embargo; available online 9 July 2018ISSN
0149-7189Version
Final accepted manuscriptAdditional Links
https://www.sciencedirect.com/science/article/pii/S0149718917302707ae974a485f413a2113503eed53cd6c53
10.1016/j.evalprogplan.2018.05.002