Name:
IJLCR_2021_20003R3_RR_MP_libra ...
Size:
2.322Mb
Format:
PDF
Description:
Final Accepted Manuscript
Publisher
John Benjamins Publishing CompanyCitation
Picoral, A., Staples, S., & Reppen, R. (2021). Automated annotation of learner English. International Journal of Learner Corpus Research, 7(1), 17–52.Rights
© John Benjamins Publishing Company.Collection Information
This item from the UA Faculty Publications collection is made available by the University of Arizona with support from the University of Arizona Libraries. If you have questions, please contact us at repository@u.library.arizona.edu.Abstract
This paper explores the use of natural language processing (NLP) tools and their utility for learner language analyses through a comparison of automatic linguistic annotation against a gold standard produced by humans. While there are a number of automated annotation tools for English currently available, little research is available on the accuracy of these tools when annotating learner data. We compare the performance of three linguistic annotation tools (a tagger and two parsers) on academic writing in English produced by learners (both L1 and L2 English speakers). We focus on lexico-grammatical patterns, including both phrasal and clausal features, since these are frequently investigated in applied linguistics studies. Our results report both precision and recall of annotation output for argumentative texts in English across four L1s: Arabic, Chinese, English, and Korean. We close with a discussion of the benefits and drawbacks of using automatic tools to annotate learner language.Note
Immediate accessISSN
2215-1478EISSN
2215-1486Version
Final accepted manuscriptae974a485f413a2113503eed53cd6c53
10.1075/ijlcr.20003.pic