ORKESTRA 3D_AR – 3D Sound for Orchestra Using Augmented Reality (AR)
Entities: Audio and Acoustics Laboratory
Consumers and music producers demand increasingly immersive and interactive experiences, creating an urgent need for innovative designs, models, and technologies. In this project, we aim to explore existing mobile digital resources based on Augmented Reality (AR) technology, using the Unity3D gaming platform.
The project encompasses the scope of audio and music engineering, more specifically, 3D sound environments, room acoustics and auralization/binaural listening, and virtual environments in games.
Explore the music of various 3D instruments placed on stage forming an orchestra, observing them in your own room through AR mechanisms. The user can walk around these instruments, hear the differences in sound in different directions, as well as the room, which influences the perception of the music due to sound reflections in the room, reverberation, and the directivity characteristics of the musical instrument. Thus, the user has the perception/perspective of “being there” on stage at a live music performance, just like the musician. This is also a teaching tool, allowing the user to mute, select, and/or move some instruments in the space during a rehearsal session.