Paper Review – Concerts of the Future: Designing an Interactive Musical Experience in VR
| Ciaran Frame. 2024. Concerts of the Future: Designing an interactive musical experience in VR. Proceedings of the International Conference on New Interfaces for Musical Expression. DOI: 10.5281/zenodo.13904880 |
For this semester’s assignment we were asked to review a paper from the NIME (New Interfaces for Musical Expression) conference. This topic sits somewhat outside the research direction I explored last semester, which focused more on interruption, attention and interaction design. However, I think stepping outside of that research boundary could offer me an interesting opportunity to look at how immersive technologies are being used in other creative fields.
The paper “Concerts of the Future: Designing an Interactive Musical Experience in VR” by Ciaran Frame presents a virtual reality system that attempts to bridge the gap between passive music listening and active musical participation. The project allows participants to enter a VR concert environment and perform alongside a chamber ensemble using a gestural digital instrument called the AirStick. Importantly, the system is designed for people without any musical training, meaning that the experience focuses more on accessibility and participation rather than musical expertise.
The motivation behind the project comes from an interesting observation: while the majority of people regularly listen to music, only a small portion actively create or perform it. Traditional concert formats reinforce a strict separation between composer, performer and audience. The project therefore explores whether VR could blur these boundaries by placing audience members directly into the performance environment.
The experience itself combines several technological and design components. Participants first enter a physical “green room” where they are introduced to the AirStick and given time to experiment with it. After this preparation phase, they put on a VR headset and are transported to a virtual concert stage where recorded musicians appear around them in a 360-degree environment. Movement of the AirStick is translated into musical output through MIDI mapping, allowing participants to generate sound by performing gestures in the air.
From a design perspective, one of the most interesting aspect of the project for me is how the creators intentionally limit the possible musical outcomes. Early tests showes that participants were often anxious about “playing the wrong note” or disrupting the performance. To address this, the system constrains the musical input so that participants always remain harmonically aligned with the ensemble. This design choice effectively creates “musical guardrails,” ensuring that users feel safe experimenting within the system.
Another notable design decision is the use of extra-VR elements, such as the green room and staged performance environment. These elements extend the experience beyond the headset and I believe it helps to construct a narrative context around the interaction. Instead of VR functioning as an isolated digital space, the project integrates physical staging to strengthen immersion.
From my perspective as someone with a background in game design and interactive media, the use of VR here is interesting primarily in terms of embodied interaction. Similar to many VR games, the experience relies on physical movement and spatial presence to create engagement. However, unlike most game environments, the participant’s agency is intentionally constrained to maintain musical coherence. This highlights a tension between creative freedom and system control, which is a recurring design challenge in interactive systems.
Overall, the paper demonstrates how VR can be used not only as a visual medium but also as a participatory performance platform. While the project is rooted in experimental music practice, it also raises broader questions about how immersive technologies can reshape the relationship between audiences and creative content. Even though my own interests lie more in interaction design than in musical interfaces, the project offers an interesting example of how immersive systems can transform traditionally passive cultural experiences.
