Development and Testing of a Thoracostomy Assessment Tool Through Self, Peer and Expert Evaluation in a Simulation Environment
PublisherThe University of Arizona.
RightsCopyright © is held by the author. Digital access to this material is made possible by the University Libraries, University of Arizona. Further transmission, reproduction or presentation (such as public display or performance) of protected items is prohibited except with permission of the author.
AbstractBackground: Self and peer evaluation using an objective assessment tool may be an effective way to evaluate procedural competency without requiring one-on-one expert attention in a simulation environment. Materials and Methods: An assessment tool was created as a checklist of critical steps involved in performing a thoracostomy. The checklist was verified by three expert physicians. Sixteen inexperienced medical students were recruited in pairs to perform one thoracostomy on a synthetic chest tube model in a simulated environment. After completing the procedure, the students used the assessment tool alongside a video recording of their procedure to conduct a self and peer evaluation. An expert physician conducted an independent evaluation of each student using the same assessment tool. The variations between the self, peer, and expert evaluations were compared to test the assessment tool for objectivity. Results: There was significant variation between self and expert evaluations (p = <0.00001 ) and between peer and expert responses (p = <0.00001). The significant variation occurred in 19 of the critical tasks. Conclusion: The assessment tool is not objective across the evaluators. Self and peer evaluation is an ineffective approach for assessing procedural competency, until variation is reduced among the 19 critical tasks.
Degree ProgramHonors College