Tuning Immersion and Performance with Adaptive Generative Music in VR

Jiayuan Wen; Daniele Giunchi; Pasquale Cascarano; Riccardo Bovo; Eyal Ofek; Anthony J. Steed

doi:10.1109/TVCG.2026.3679907

Tuning Immersion and Performance with Adaptive Generative Music in VR

Jiayuan Wen
, Daniele Giunchi
, Pasquale Cascarano
, Riccardo Bovo
, Eyal Ofek
, Anthony J. Steed

Computer Science

Research output: Contribution to journal › Article › peer-review

Abstract

Music in virtual environments often enhances atmosphere and pacing, not performance. AI/procedural audio enable real-time adaptive soundtracks, but their behavioral effects in HMD-VR are unclear. We built a VR archery system with Unity, Google MusicFXDJ, Ubiq-Genie generating music from gameplay events. In a within-subjects study (N=22), participants shot with a matched fixed soundtrack or an adaptive one that raised tension in four phases as arrows ran out. Adaptive music increased presence and emotional impact and produced an inverted-U on precision: moderate tension improved accuracy and aiming time; high tension impaired both. AI music can act as feedback for VR training/rehab/entertainment.

Original language	English
Journal	IEEE transactions on visualization and computer graphics
DOIs	https://doi.org/10.1109/TVCG.2026.3679907
Publication status	E-pub ahead of print - 1 Apr 2026

Keywords

Virtual Reality
Adaptive Music
Generative Audio
Presence
Arousal
Performance
User Study

Access to Document

10.1109/TVCG.2026.3679907

Tuning Immersion and Performance with Adaptive Generative Music in VR
Wen, J., Giunchi, D., Cascarano, P., Bovo, R., Ofek, E. & Steed, A. J., 21 Mar 2026, (Accepted/In press) 2026 IEEE Conference Virtual Reality and 3D User Interfaces (VR). IEEE, (IEEE Conference on Virtual Reality and 3D User Interfaces (VR)).
Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Open Access
File

Cite this

@article{0a4dac67eea54cdc91ab67ace590155c,

title = "Tuning Immersion and Performance with Adaptive Generative Music in VR",

abstract = "Music in virtual environments often enhances atmosphere and pacing, not performance. AI/procedural audio enable real-time adaptive soundtracks, but their behavioral effects in HMD-VR are unclear. We built a VR archery system with Unity, Google MusicFXDJ, Ubiq-Genie generating music from gameplay events. In a within-subjects study (N=22), participants shot with a matched fixed soundtrack or an adaptive one that raised tension in four phases as arrows ran out. Adaptive music increased presence and emotional impact and produced an inverted-U on precision: moderate tension improved accuracy and aiming time; high tension impaired both. AI music can act as feedback for VR training/rehab/entertainment.",

keywords = "Virtual Reality, Adaptive Music, Generative Audio, Presence, Arousal, Performance, User Study",

author = "Jiayuan Wen and Daniele Giunchi and Pasquale Cascarano and Riccardo Bovo and Eyal Ofek and Steed, \{Anthony J.\}",

year = "2026",

month = apr,

day = "1",

doi = "10.1109/TVCG.2026.3679907",

language = "English",

journal = "IEEE transactions on visualization and computer graphics",

issn = "1077-2626",

publisher = "Institute of Electrical and Electronics Engineers (IEEE)",

}

TY - JOUR

T1 - Tuning Immersion and Performance with Adaptive Generative Music in VR

AU - Wen, Jiayuan

AU - Giunchi, Daniele

AU - Cascarano, Pasquale

AU - Bovo, Riccardo

AU - Ofek, Eyal

AU - Steed, Anthony J.

PY - 2026/4/1

Y1 - 2026/4/1

N2 - Music in virtual environments often enhances atmosphere and pacing, not performance. AI/procedural audio enable real-time adaptive soundtracks, but their behavioral effects in HMD-VR are unclear. We built a VR archery system with Unity, Google MusicFXDJ, Ubiq-Genie generating music from gameplay events. In a within-subjects study (N=22), participants shot with a matched fixed soundtrack or an adaptive one that raised tension in four phases as arrows ran out. Adaptive music increased presence and emotional impact and produced an inverted-U on precision: moderate tension improved accuracy and aiming time; high tension impaired both. AI music can act as feedback for VR training/rehab/entertainment.

AB - Music in virtual environments often enhances atmosphere and pacing, not performance. AI/procedural audio enable real-time adaptive soundtracks, but their behavioral effects in HMD-VR are unclear. We built a VR archery system with Unity, Google MusicFXDJ, Ubiq-Genie generating music from gameplay events. In a within-subjects study (N=22), participants shot with a matched fixed soundtrack or an adaptive one that raised tension in four phases as arrows ran out. Adaptive music increased presence and emotional impact and produced an inverted-U on precision: moderate tension improved accuracy and aiming time; high tension impaired both. AI music can act as feedback for VR training/rehab/entertainment.

KW - Virtual Reality

KW - Adaptive Music

KW - Generative Audio

KW - Presence

KW - Arousal

KW - Performance

KW - User Study

U2 - 10.1109/TVCG.2026.3679907

DO - 10.1109/TVCG.2026.3679907

M3 - Article

SN - 1077-2626

JO - IEEE transactions on visualization and computer graphics

JF - IEEE transactions on visualization and computer graphics

ER -

Tuning Immersion and Performance with Adaptive Generative Music in VR

Abstract

Keywords

Access to Document

Fingerprint

Research output

Tuning Immersion and Performance with Adaptive Generative Music in VR

Cite this