CUILESS2016: a clinical corpus applying compositional normalization of text mentions
AffiliationUniv Arizona, Sch Informat
Fine grained named entity recognition
MetadataShow full item record
PublisherBIOMED CENTRAL LTD
CitationCUILESS2016: a clinical corpus applying compositional normalization of text mentions 2018, 9 (1) Journal of Biomedical Semantics
JournalJournal of Biomedical Semantics
Rights© The Author(s). 2018 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License.
Collection InformationThis item from the UA Faculty Publications collection is made available by the University of Arizona with support from the University of Arizona Libraries. If you have questions, please contact us at email@example.com.
AbstractBackground: Traditionally text mention normalization corpora have normalized concepts to single ontology identifiers ("pre-coordinated concepts"). Less frequently, normalization corpora have used concepts with multiple identifiers ("post-coordinated concepts") but the additional identifiers have been restricted to a defined set of relationships to the core concept. This approach limits the ability of the normalization process to express semantic meaning. We generated a freely available corpus using post-coordinated concepts without a defined set of relationships that we term "compositional concepts" to evaluate their use in clinical text. Methods: We annotated 5397 disorder mentions from the ShARe corpus to SNOMED CT that were previously normalized as "CUI-less" in the "SemEval-2015 Task 14" shared task because they lacked a pre-coordinated mapping. Unlike the previous normalization method, we do not restrict concept mappings to a particular set of the Unified Medical Language System (UMLS) semantic types and allow normalization to occur to multiple UMLS Concept Unique Identifiers (CUIs). We computed annotator agreement and assessed semantic coverage with this method. Results: We generated the largest clinical text normalization corpus to date with mappings to multiple identifiers and made it freely available. All but 8 of the 5397 disorder mentions were normalized using this methodology. Annotator agreement ranged from 52.4% using the strictest metric (exact matching) to 78.2% using a hierarchical agreement that measures the overlap of shared ancestral nodes. Conclusion: Our results provide evidence that compositional concepts can increase semantic coverage in clinical text. To our knowledge we provide the first freely available corpus of compositional concept annotation in clinical text.
NoteOpen access journal.
VersionFinal published version
SponsorsNational Institutes of Health; National Center for Advancing Translational Sciences [UL1TR001417]; National Institute of General Medicine Science, "Extended Methods and Software Development for Health NLP" [1R01GM114355]
- NCBI disease corpus: a resource for disease name recognition and concept normalization.
- Authors: Doğan RI, Leaman R, Lu Z
- Issue date: 2014 Feb
- Normalizing clinical terms using learned edit distance patterns.
- Authors: Kate RJ
- Issue date: 2016 Mar
- Evaluating the impact of pre-annotation on annotation speed and potential bias: natural language processing gold standard development for clinical named entity recognition in clinical trial announcements.
- Authors: Lingren T, Deleger L, Molnar K, Zhai H, Meinzen-Derr J, Kaiser M, Stoutenborough L, Li Q, Solti I
- Issue date: 2014 May-Jun
- Concept annotation in the CRAFT corpus.
- Authors: Bada M, Eckert M, Evans D, Garcia K, Shipley K, Sitnikov D, Baumgartner WA Jr, Cohen KB, Verspoor K, Blake JA, Hunter LE
- Issue date: 2012 Jul 9
- Evaluating the state of the art in disorder recognition and normalization of the clinical narrative.
- Authors: Pradhan S, Elhadad N, South BR, Martinez D, Christensen L, Vogel A, Suominen H, Chapman WW, Savova G
- Issue date: 2015 Jan