Affect and Semantic Interpretation of Virtual Drama

Li Zhang, John Barnden

Research output: Chapter in Book/Report/Conference proceedingConference contribution


We have developed an intelligent agent to engage with users in virtual drama improvisation previously. The intelligent agent was able to perform sentence-level affect detection especially from user inputs with strong emotional indicators. However, we noticed that emotional expressions are diverse and many inputs with weak or no affect indicators also contain emotional indications but were regarded as neutral expressions by the previous processing. In this paper, we employ latent semantic analysis to perform topic theme detection and intended audience identification for such inputs. Then we also discuss how affect is detected for such inputs without strong emotional linguistic features with the consideration of emotions expressed by the most intended audiences and interpersonal relationships between speakers and audiences. Moreover, uncertainty-based active learning is also employed in this research in order to deal with more open-ended and imbalanced affect detection tasks within or going beyond the selected scenarios. Overall, the work presented here enables the intelligent agent to derive the underlying semantic structures embedded in emotional expressions and deal with challenging issues in affect detection tasks.

Original languageEnglish
Title of host publicationIntelligent Technologies for Interactive Entertainment
Subtitle of host publication6th International Conference, INTETAIN 2014, Chicago, IL, USA, July 9-11, 2014. Proceedings
EditorsDennis Reidsma, Insook Choi, Robin Bargar
Number of pages10
Volume136 LNICST
ISBN (Electronic)9783319081892
ISBN (Print)9783319081885
Publication statusPublished - 2014
Event6th International ICST Conference on Intelligent Technologies for Interactive Entertainment, INTETAIN 2014 - Chicago, IL, United States
Duration: 9 Jul 201411 Jul 2014

Publication series

NameLecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST
Volume136 LNICST
ISSN (Print)1867-8211


Conference6th International ICST Conference on Intelligent Technologies for Interactive Entertainment, INTETAIN 2014
Country/TerritoryUnited States
CityChicago, IL


  • Affect Detection
  • Semantic Interpretation and Drama Improvisation

ASJC Scopus subject areas

  • Computer Networks and Communications


Dive into the research topics of 'Affect and Semantic Interpretation of Virtual Drama'. Together they form a unique fingerprint.

Cite this