VRSoundMapper is an immersive sonic playground where users can shape sound movement in a 3D virtual environment. “Grab” a sound object to move it around the space, place waypoints to design intricate spatial trajectories, or use gravity simulations to create complex orbital patterns. All generated sounds can be recorded for later playback on headphones or multi-channel speaker arrangements. Release planned for Fall 2018.
Built in the Unity video game engine, VRSoundMapper was created with the purpose of using virtual reality as a tool for designing 3D spatial audio experiences. While many tools exist for this purpose, most rely on a 2D interface to position sounds. Virtual reality presents an opportunity to work with 3D sound in a more intuitive manner, utilizing the HTC Vive’s room tracking technology to operate in a 3D generated environment.
— Support for 1st order ambisonic recording (Spatialization done with Google Resonance)
— Audio reactive shader to increase visual perception
— Recording of animation data for sound objects
— Waypoint system to automate sound trajectories
— Gravity simulations to move sound objects using Playing with Gravity
Orbital Oscillations (2016)
Virtual Reality environment created for the HTC Vive in Unity
Created for David Stout’s 2017 Intermedia class using google cardboard devices. The Merrill Ellis Intermedia Theater was transformed into surreal 3D spaces.