A stepwise method for annotating APPRAISAL

Matteo Fuoli

doi:10.1075/fol.15016.fuo

A stepwise method for annotating APPRAISAL

Matteo Fuoli

English Language and Linguistics

Research output: Contribution to journal › Article › peer-review

12 Citations (Scopus)

531 Downloads (Pure)

Abstract

Despite a growing awareness of methodological issues, the literature on APPRAISAL has not so far provided adequate answers to some of the key challenges involved in reliably identifying and classifying evaluative language expressions. This article presents a step-wise method for the manual annotation of APPRAISAL in text that is designed to optimize reliability, replicability and transparency. The procedure consists of seven steps, from the creation of a context-specific annotation manual to the statistical analysis of the quantitative data derived from the manually-performed annotations. By presenting this method, the article pursues the twofold purpose of (i) providing a practical tool that can facilitate more reliable, replicable and transparent analyses, and (ii) fostering a discussion of the best practices that should be observed when manually annotating APPRAISAL.

Original language	English
Pages (from-to)	229-258
Number of pages	30
Journal	Functions of Language
Volume	25
Issue number	2
DOIs	https://doi.org/10.1075/fol.15016.fuo
Publication status	Published - Jan 2018

Keywords

reliability
replicability
transparency
inter-coder agreement
intra-coder agreement
challenges in analyzing APPRAISAL

Access to Document

10.1075/fol.15016.fuo

Fuoli_A_step_wise_method_for_annotating_APPRAISAL_Functions_of_Language
Fuoli, M. Forthcoming. ‘A step-wise method for annotating APPRAISAL’, Functions of Language 25 (2) https://doi.org/10.1075/fol.15016.fuo Article is under copyright. Contact the publisher for permission to re-use or reprint the material in any form.
Accepted author manuscript, 768 KBLicence: Other (please specify with Rights Statement)

Cite this

@article{94f371d9d1a740fb8c960154465b0fe3,

title = "A stepwise method for annotating APPRAISAL",

abstract = "Despite a growing awareness of methodological issues, the literature on APPRAISAL has not so far provided adequate answers to some of the key challenges involved in reliably identifying and classifying evaluative language expressions. This article presents a step-wise method for the manual annotation of APPRAISAL in text that is designed to optimize reliability, replicability and transparency. The procedure consists of seven steps, from the creation of a context-specific annotation manual to the statistical analysis of the quantitative data derived from the manually-performed annotations. By presenting this method, the article pursues the twofold purpose of (i) providing a practical tool that can facilitate more reliable, replicable and transparent analyses, and (ii) fostering a discussion of the best practices that should be observed when manually annotating APPRAISAL.",

keywords = "reliability, replicability, transparency, inter-coder agreement, intra-coder agreement, challenges in analyzing APPRAISAL",

author = "Matteo Fuoli",

year = "2018",

month = jan,

doi = "10.1075/fol.15016.fuo",

language = "English",

volume = "25",

pages = "229--258",

journal = "Functions of Language",

issn = "0929-998X",

publisher = "John Benjamins Publishing",

number = "2",

}

TY - JOUR

T1 - A stepwise method for annotating APPRAISAL

AU - Fuoli, Matteo

PY - 2018/1

Y1 - 2018/1

N2 - Despite a growing awareness of methodological issues, the literature on APPRAISAL has not so far provided adequate answers to some of the key challenges involved in reliably identifying and classifying evaluative language expressions. This article presents a step-wise method for the manual annotation of APPRAISAL in text that is designed to optimize reliability, replicability and transparency. The procedure consists of seven steps, from the creation of a context-specific annotation manual to the statistical analysis of the quantitative data derived from the manually-performed annotations. By presenting this method, the article pursues the twofold purpose of (i) providing a practical tool that can facilitate more reliable, replicable and transparent analyses, and (ii) fostering a discussion of the best practices that should be observed when manually annotating APPRAISAL.

AB - Despite a growing awareness of methodological issues, the literature on APPRAISAL has not so far provided adequate answers to some of the key challenges involved in reliably identifying and classifying evaluative language expressions. This article presents a step-wise method for the manual annotation of APPRAISAL in text that is designed to optimize reliability, replicability and transparency. The procedure consists of seven steps, from the creation of a context-specific annotation manual to the statistical analysis of the quantitative data derived from the manually-performed annotations. By presenting this method, the article pursues the twofold purpose of (i) providing a practical tool that can facilitate more reliable, replicable and transparent analyses, and (ii) fostering a discussion of the best practices that should be observed when manually annotating APPRAISAL.

KW - reliability

KW - replicability

KW - transparency

KW - inter-coder agreement

KW - intra-coder agreement

KW - challenges in analyzing APPRAISAL

U2 - 10.1075/fol.15016.fuo

DO - 10.1075/fol.15016.fuo

M3 - Article

SN - 0929-998X

VL - 25

SP - 229

EP - 258

JO - Functions of Language

JF - Functions of Language

IS - 2

ER -

A stepwise method for annotating APPRAISAL

Abstract

Keywords

Access to Document

Fingerprint

Cite this