Abstract
Speech/voice disorders are common in People Living with Dementia (PLwD). Fluctuations in speech quality can serve as biomarkers of cognitive deterioration but there is a gap in automated assessment of speech collected in unstructured environs. Our organisation has deployed Alexa in the households of 14 PLwD to track self-reported mental and physical state as well as use of language.
n this work, we present a case study analysing highly variable speech over time, providing potential insights into cognitive changes. Alexa data gathered from the participant was manually annotated with speech assessment labels. Those labels are matched to openSMILE features by performing a feature importance analysis to isolate critical features that contribute to the perceptual ratings. We can assess phonation with a F1-score of 0.55, breathiness: 0.71, roughness: 0.60, asthenia: 0.65, strain: 0.74. This work is a first step towards automatic speech assessment to monitor cognitive impairment over time.
Original language | English |
---|---|
Title of host publication | INTERSPEECH 2023 |
Publisher | ISCA |
Pages | 4508-4512 |
Number of pages | 5 |
DOIs | |
Publication status | Published - 24 Aug 2023 |
Event | 24th International Speech Communication Association, Interspeech 2023 - Dublin, Ireland Duration: 20 Aug 2023 → 24 Aug 2023 |
Publication series
Name | Interspeech |
---|---|
ISSN (Electronic) | 2958-1796 |
Conference
Conference | 24th International Speech Communication Association, Interspeech 2023 |
---|---|
Country/Territory | Ireland |
City | Dublin |
Period | 20/08/23 → 24/08/23 |
Bibliographical note
Funding Information:This work is supported by the UK Dementia Research Institute (UKDRI-7003) which receives its funding from UK DRI Ltd, funded by the UK Medical Research Council, Alzheimer’s Society and Alzheimer’s Research UK.
Publisher Copyright:
© 2023 International Speech Communication Association. All rights reserved.
Keywords
- computational paralinguistics
- human-computer interaction
- speech recognition
ASJC Scopus subject areas
- Language and Linguistics
- Human-Computer Interaction
- Signal Processing
- Software
- Modelling and Simulation