Matching Acoustic and Perceptual Measures of Phonation Assessment in Disordered Speech - A Case Study

Melanie Jouaiti, Pippa Kirby, Ravi Vaidyanathan

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Speech/voice disorders are common in People Living with Dementia (PLwD). Fluctuations in speech quality can serve as biomarkers of cognitive deterioration but there is a gap in automated assessment of speech collected in unstructured environs. Our organisation has deployed Alexa in the households of 14 PLwD to track self-reported mental and physical state as well as use of language.

n this work, we present a case study analysing highly variable speech over time, providing potential insights into cognitive changes. Alexa data gathered from the participant was manually annotated with speech assessment labels. Those labels are matched to openSMILE features by performing a feature importance analysis to isolate critical features that contribute to the perceptual ratings. We can assess phonation with a F1-score of 0.55, breathiness: 0.71, roughness: 0.60, asthenia: 0.65, strain: 0.74. This work is a first step towards automatic speech assessment to monitor cognitive impairment over time.

Original languageEnglish
Title of host publicationINTERSPEECH 2023
PublisherISCA
Pages4508-4512
Number of pages5
DOIs
Publication statusPublished - 24 Aug 2023
Event24th International Speech Communication Association, Interspeech 2023 - Dublin, Ireland
Duration: 20 Aug 202324 Aug 2023

Publication series

NameInterspeech
ISSN (Electronic)2958-1796

Conference

Conference24th International Speech Communication Association, Interspeech 2023
Country/TerritoryIreland
CityDublin
Period20/08/2324/08/23

Bibliographical note

Funding Information:
This work is supported by the UK Dementia Research Institute (UKDRI-7003) which receives its funding from UK DRI Ltd, funded by the UK Medical Research Council, Alzheimer’s Society and Alzheimer’s Research UK.

Publisher Copyright:
© 2023 International Speech Communication Association. All rights reserved.

Keywords

  • computational paralinguistics
  • human-computer interaction
  • speech recognition

ASJC Scopus subject areas

  • Language and Linguistics
  • Human-Computer Interaction
  • Signal Processing
  • Software
  • Modelling and Simulation

Fingerprint

Dive into the research topics of 'Matching Acoustic and Perceptual Measures of Phonation Assessment in Disordered Speech - A Case Study'. Together they form a unique fingerprint.

Cite this