CUILESS2016: a clinical corpus applying compositional normalization of text mentions
AffiliationUniv Arizona, Sch Informat
Fine grained named entity recognition
MetadataShow full item record
PublisherBIOMED CENTRAL LTD
CitationCUILESS2016: a clinical corpus applying compositional normalization of text mentions 2018, 9 (1) Journal of Biomedical Semantics
JournalJournal of Biomedical Semantics
Rights© The Author(s). 2018 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License.
Collection InformationThis item from the UA Faculty Publications collection is made available by the University of Arizona with support from the University of Arizona Libraries. If you have questions, please contact us at email@example.com.
AbstractBackground: Traditionally text mention normalization corpora have normalized concepts to single ontology identifiers ("pre-coordinated concepts"). Less frequently, normalization corpora have used concepts with multiple identifiers ("post-coordinated concepts") but the additional identifiers have been restricted to a defined set of relationships to the core concept. This approach limits the ability of the normalization process to express semantic meaning. We generated a freely available corpus using post-coordinated concepts without a defined set of relationships that we term "compositional concepts" to evaluate their use in clinical text. Methods: We annotated 5397 disorder mentions from the ShARe corpus to SNOMED CT that were previously normalized as "CUI-less" in the "SemEval-2015 Task 14" shared task because they lacked a pre-coordinated mapping. Unlike the previous normalization method, we do not restrict concept mappings to a particular set of the Unified Medical Language System (UMLS) semantic types and allow normalization to occur to multiple UMLS Concept Unique Identifiers (CUIs). We computed annotator agreement and assessed semantic coverage with this method. Results: We generated the largest clinical text normalization corpus to date with mappings to multiple identifiers and made it freely available. All but 8 of the 5397 disorder mentions were normalized using this methodology. Annotator agreement ranged from 52.4% using the strictest metric (exact matching) to 78.2% using a hierarchical agreement that measures the overlap of shared ancestral nodes. Conclusion: Our results provide evidence that compositional concepts can increase semantic coverage in clinical text. To our knowledge we provide the first freely available corpus of compositional concept annotation in clinical text.
NoteOpen access journal.
VersionFinal published version
SponsorsNational Institutes of Health; National Center for Advancing Translational Sciences [UL1TR001417]; National Institute of General Medicine Science, "Extended Methods and Software Development for Health NLP" [1R01GM114355]
Except where otherwise noted, this item's license is described as © The Author(s). 2018 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License.
- Unified Medical Language System resources improve sieve-based generation and Bidirectional Encoder Representations from Transformers (BERT)-based ranking for concept normalization.
- Authors: Xu D, Gopale M, Zhang J, Brown K, Begoli E, Bethard S
- Issue date: 2020 Oct 1
- MCN: A comprehensive corpus for medical concept normalization.
- Authors: Luo YF, Sun W, Rumshisky A
- Issue date: 2019 Apr
- Quantitative analysis of manual annotation of clinical text samples.
- Authors: Miñarro-Giménez JA, Cornet R, Jaulent MC, Dewenter H, Thun S, Gøeg KR, Karlsson D, Schulz S
- Issue date: 2019 Mar
- Development and evaluation of RapTAT: a machine learning system for concept mapping of phrases from medical narratives.
- Authors: Gobbel GT, Reeves R, Jayaramaraja S, Giuse D, Speroff T, Brown SH, Elkin PL, Matheny ME
- Issue date: 2014 Apr
- The 2019 National Natural language processing (NLP) Clinical Challenges (n2c2)/Open Health NLP (OHNLP) shared task on clinical concept normalization for clinical records.
- Authors: Henry S, Wang Y, Shen F, Uzuner O
- Issue date: 2020 Oct 1