Affective Landscapes: Navigating the Emotional Impact of Multisensory Stimuli in Virtual Reality

In this study we explore the impact of multisensory stimuli in virtual reality on users’ emotional responses, addressing a knowledge gap in this rapidly evolving field. Utilizing a range of sensory inputs, including taste, haptics, and smell, in addition to audiovisual cues, this study aims to understand how different combinations of these stimuli affect the users’ emotional experience. Two immersive virtual experiences have been developed for this purpose. One included a scenario to evoke positive emotions through selectively chosen pleasant multisensory stimuli, validated in a focus group. The other sought the contrary: to trigger negative emotions by integrating selected combinations of unpleasant multisensory stimuli, also validated in the same focus group. Through a comparative analysis, our findings revealed significant differences in emotional responses between the groups exposed to positive and negative stimuli combinations. Results indicated that combinations involving haptics and taste were particularly effective in eliciting intense emotions using positive stimuli, but their impact was less significant with negative stimuli. This investigation suggests that a fully multisensory virtual environment integrating positive stimuli might lead to cognitive overload, reducing overall emotional responses. In contrast, environments with negative stimuli could enhance emotional engagement and be more likely to avoid cognitive overload. These findings have important implications for designing emotionally resonant and compelling virtual reality experiences. This research enhances the understanding of sensory integration in virtual reality and its effects on emotional engagement, offering valuable insights for developing more impactful virtual experiences.