Convolution, Virtual Acoustics, and Interactions with Impossible Worlds

This paper presents a discussion on a series of artworks created by the authors that explore the potential of using sound produced in virtual spaces as artistic materials. Specifically, the works under discussion generate unique spatial and auralization effects that are achieved through the use of novel convolution techniques and immersive virtual acoustic technologies. We demonstrate our novel convolution techniques for deriving impulse responses from non-spatial sources, such as audio signals, and explain how these impulse responses have been employed in creating immersive installations for both web-based experiences and in-person interactive installations and performances. The impulse responses used in this work are obtained from sources including recordings of medieval hand-bells, the singing of Gesualdo madrigals, spoken texts, ambient street sounds, and more. The online works discussed in this paper are diffused through loudspeakers and headphones, while the interactive in-person installations and performances are diffused over headphones or through the loudspeakers of mobile convolution-based virtual acoustic systems. Several audio-visual examples to illustrate the techniques and outcomes of the work are included.