Spelling errors and keywords in born-digital data: a case study using the Teenage Health Freak Corpus

Research output: Contribution to journalArticlepeer-review

Authors

Colleges, School and Institutes

Abstract

The abundance of language data that is now available in digital form, and the rise of distinct language varieties that are used for digital communication, means that issues of non-standard spellings and spelling errors are, in future, likely to become more prominent for compilers of corpora. This paper examines the effect of spelling variation on keywords in a born-digital corpus in order to explore the extent and impact of this variation for future corpus studies. The corpus used in this study consists of e-mails about health concerns that were sent to a health website by adolescents. Keywords are generated using the original version of the corpus and a version with spelling errors corrected, and the British National Corpus (BNC) acts as the reference corpus. The ranks of the keywords are shown to be very similar and, therefore, suggest that, depending on the research goals, keywords could be generated reliably without any need for spelling correction.

Details

Original languageEnglish
Pages (from-to)137-154
JournalCorpora
Volume9
Issue number2
Publication statusPublished - 1 Nov 2014