Show simple item record

dc.contributor.authorLeroy, G.
dc.contributor.authorKauchak, D.
dc.contributor.authorHaeger, D.
dc.contributor.authorSpegman, D.
dc.date.accessioned2022-08-25T00:52:11Z
dc.date.available2022-08-25T00:52:11Z
dc.date.issued2022
dc.identifier.citationLeroy, G., Kauchak, D., Haeger, D., & Spegman, D. (2022). Evaluation of an online text simplification editor using manual and automated metrics for perceived and actual text difficulty. JAMIA Open, 5(2).
dc.identifier.issn2574-2531
dc.identifier.doi10.1093/jamiaopen/ooac044
dc.identifier.urihttp://hdl.handle.net/10150/665949
dc.description.abstractObjective: Simplifying healthcare text to improve understanding is difficult but critical to improve health literacy. Unfortunately, few tools exist that have been shown objectively to improve text and understanding. We developed an online editor that integrates simplification algorithms that suggest concrete simplifications, all of which have been shown individually to affect text difficulty. Materials and Methods: The editor was used by a health educator at a local community health center to simplify 4 texts. A controlled experiment was conducted with community center members to measure perceived and actual difficulty of the original and simplified texts. Perceived difficulty was measured using a Likert scale; actual difficulty with multiple-choice questions and with free recall of information evaluated by the educator and 2 sets of automated metrics. Results: The results show that perceived difficulty improved with simplification. Several multiple-choice questions, measuring actual difficulty, were answered more correctly with the simplified text. Free recall of information showed no improvement based on the educator evaluation but was better for simplified texts when measured with automated metrics. Two follow-up analyses showed that self-reported education level and the amount of English spoken at home positively correlated with question accuracy for original texts and the effect disappears with simplified text. Discussion: Simplifying text is difficult and the results are subtle. However, using a variety of different metrics helps quantify the effects of changes. Conclusion: Text simplification can be supported by algorithmic tools. Without requiring tool training or linguistic knowledge, our simplification editor helped simplify healthcare related texts. © 2022 The Author(s). Published by Oxford University Press on behalf of the American Medical Informatics Association.
dc.language.isoen
dc.publisherOxford University Press
dc.rightsCopyright © The Author(s) 2022. Published by Oxford University Press on behalf of the American Medical Informatics Association. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/).
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/
dc.subjecthealth literacy
dc.subjectmetrics
dc.subjecttext difficulty
dc.subjecttext simplification
dc.subjectuser study
dc.titleEvaluation of an online text simplification editor using manual and automated metrics for perceived and actual text difficulty
dc.typeArticle
dc.typetext
dc.contributor.departmentManagement Information Systems, Eller College of Management, University of Arizona
dc.identifier.journalJAMIA Open
dc.description.noteOpen access journal
dc.description.collectioninformationThis item from the UA Faculty Publications collection is made available by the University of Arizona with support from the University of Arizona Libraries. If you have questions, please contact us at repository@u.library.arizona.edu.
dc.eprint.versionFinal published version
dc.source.journaltitleJAMIA Open
refterms.dateFOA2022-08-25T00:52:12Z


Files in this item

Thumbnail
Name:
ooac044.pdf
Size:
822.6Kb
Format:
PDF
Description:
Final Published Version

This item appears in the following Collection(s)

Show simple item record

Copyright © The Author(s) 2022. Published by Oxford University Press on behalf of the American Medical Informatics Association. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/).
Except where otherwise noted, this item's license is described as Copyright © The Author(s) 2022. Published by Oxford University Press on behalf of the American Medical Informatics Association. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/).