Evaluation beyond Usability:: Validating Sustainable HCI Research

Christian  Remy; Oliver Bates; Alan Dix; Vanessa Thomas; Mike  Hazas; Adrian Friday; Elaine M. Huang

doi:10.1145/3173574.3173790

Evaluation beyond Usability: Validating Sustainable HCI Research

Christian Remy, Oliver Bates, Alan Dix, Vanessa Thomas, Mike Hazas, Adrian Friday, Elaine M. Huang

Computer Science

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

16 Citations (Scopus)

Abstract

The evaluation of research artefacts is an important step to validate research contributions. Sub-disciplines of HCI often pursue primary goals other than usability, such as Sustainable HCI (SHCI), HCI for development, or health and wellbeing. For such disciplines, established evaluation methods are not always appropriate or sufficient, and new conventions for identifying, discussing, and justifying suitable evaluation methods need to be established. In this paper, we revisit the purpose and goals of evaluation in HCI and SHCI, and elicit five key elements that can provide guidance to identifying evaluation methods for SHCI
research. Our essay is meant as a starting point for discussing current and improving future evaluation practice in SHCI; we also believe it holds value for other subdisciplines in HCI that encounter similar challenges while evaluating their research.

Original language	English
Title of host publication	Proceedings of ACM CHI 2018 Conference on Human Factors in Computing Systems
Publisher	Association for Computing Machinery
Number of pages	15
ISBN (Print)	978-1-4503-5620-6
DOIs	https://doi.org/10.1145/3173574.3173790
Publication status	Published - 21 Apr 2018
Event	ACM CHI 2018 Conference on Human Factors in Computing Systems (CHI 2018) - Montreal, Canada Duration: 21 Apr 2018 → 26 Apr 2018 https://chi2018.acm.org/

Conference

Conference	ACM CHI 2018 Conference on Human Factors in Computing Systems (CHI 2018)
Country/Territory	Canada
City	Montreal
Period	21/04/18 → 26/04/18
Internet address	https://chi2018.acm.org/

Keywords

Sustainable HCI
Sustainability
Evaluation
Validation

Access to Document

10.1145/3173574.3173790Licence: None: All rights reserved

Cite this

@inproceedings{4132db742e114a62be6267bc2c0c32fc,

title = "Evaluation beyond Usability:: Validating Sustainable HCI Research",

abstract = "The evaluation of research artefacts is an important step to validate research contributions. Sub-disciplines of HCI often pursue primary goals other than usability, such as Sustainable HCI (SHCI), HCI for development, or health and wellbeing. For such disciplines, established evaluation methods are not always appropriate or sufficient, and new conventions for identifying, discussing, and justifying suitable evaluation methods need to be established. In this paper, we revisit the purpose and goals of evaluation in HCI and SHCI, and elicit five key elements that can provide guidance to identifying evaluation methods for SHCIresearch. Our essay is meant as a starting point for discussing current and improving future evaluation practice in SHCI; we also believe it holds value for other subdisciplines in HCI that encounter similar challenges while evaluating their research.",

keywords = "Sustainable HCI, Sustainability, Evaluation, Validation",

author = "Christian Remy and Oliver Bates and Alan Dix and Vanessa Thomas and Mike Hazas and Adrian Friday and Huang, {Elaine M.}",

year = "2018",

month = apr,

day = "21",

doi = "10.1145/3173574.3173790",

language = "English",

isbn = "978-1-4503-5620-6",

booktitle = "Proceedings of ACM CHI 2018 Conference on Human Factors in Computing Systems",

publisher = "Association for Computing Machinery ",

note = "ACM CHI 2018 Conference on Human Factors in Computing Systems (CHI 2018) ; Conference date: 21-04-2018 Through 26-04-2018",

url = "https://chi2018.acm.org/",

}

Remy, C, Bates, O, Dix, A, Thomas, V, Hazas, M, Friday, A & Huang, EM 2018, Evaluation beyond Usability: Validating Sustainable HCI Research. in Proceedings of ACM CHI 2018 Conference on Human Factors in Computing Systems., 216, Association for Computing Machinery , ACM CHI 2018 Conference on Human Factors in Computing Systems (CHI 2018), Montreal, Canada, 21/04/18. https://doi.org/10.1145/3173574.3173790

TY - GEN

T1 - Evaluation beyond Usability:

T2 - ACM CHI 2018 Conference on Human Factors in Computing Systems (CHI 2018)

AU - Remy, Christian

AU - Bates, Oliver

AU - Dix, Alan

AU - Thomas, Vanessa

AU - Hazas, Mike

AU - Friday, Adrian

AU - Huang, Elaine M.

PY - 2018/4/21

Y1 - 2018/4/21

N2 - The evaluation of research artefacts is an important step to validate research contributions. Sub-disciplines of HCI often pursue primary goals other than usability, such as Sustainable HCI (SHCI), HCI for development, or health and wellbeing. For such disciplines, established evaluation methods are not always appropriate or sufficient, and new conventions for identifying, discussing, and justifying suitable evaluation methods need to be established. In this paper, we revisit the purpose and goals of evaluation in HCI and SHCI, and elicit five key elements that can provide guidance to identifying evaluation methods for SHCIresearch. Our essay is meant as a starting point for discussing current and improving future evaluation practice in SHCI; we also believe it holds value for other subdisciplines in HCI that encounter similar challenges while evaluating their research.

AB - The evaluation of research artefacts is an important step to validate research contributions. Sub-disciplines of HCI often pursue primary goals other than usability, such as Sustainable HCI (SHCI), HCI for development, or health and wellbeing. For such disciplines, established evaluation methods are not always appropriate or sufficient, and new conventions for identifying, discussing, and justifying suitable evaluation methods need to be established. In this paper, we revisit the purpose and goals of evaluation in HCI and SHCI, and elicit five key elements that can provide guidance to identifying evaluation methods for SHCIresearch. Our essay is meant as a starting point for discussing current and improving future evaluation practice in SHCI; we also believe it holds value for other subdisciplines in HCI that encounter similar challenges while evaluating their research.

KW - Sustainable HCI

KW - Sustainability

KW - Evaluation

KW - Validation

U2 - 10.1145/3173574.3173790

DO - 10.1145/3173574.3173790

M3 - Conference contribution

SN - 978-1-4503-5620-6

BT - Proceedings of ACM CHI 2018 Conference on Human Factors in Computing Systems

PB - Association for Computing Machinery

Y2 - 21 April 2018 through 26 April 2018

ER -