In my last blog entry, I outlined a possible solution and workflow for creating mockups and
prototypes for multimedia installations within the scope of sound art and visual arts. I think
the best option, regarding prototyping, would be to blend multiple existing programs to
create something that covers all my needs. This blend could consist of Pyroomacoustics,
Blender, TouchDesigner, and some type of game engine. A game engine would work
particularly well, as it would allow us to explore digital versions of installations in first person.
With this approach, the soundscape can be further enriched, since we can more accurately
spatialize sound. Such an approach could work not only for mockups, but also for the
creation of standalone virtual installations open to the public.
I was also introduced to a new program for 3D modeling called Fusion 360, which offers solid
accuracy for tackling mechanical structures that can be used for sculptures and
installations. I first heard about this software during our excursion to ESC Medien Kunst
Labor, where we attended a talk by Jiří Suchánek, a Czech sound and media artist whose
philosophy of development and prototyping somewhat aligns with my own.
Regardless of which combination of programs I ultimately choose, I am considering creating
or assembling the software as a joint collaboration with Maximilian Bernhard, a sound design
colleague who has similar ideas in mind for his project.
Regarding the theme of the installation, I am currently considering two directions.
The first possible direction is the physical reimagining and sonification of digital artifacts.
The idea is to create unpredictable results in the digital domain by intentionally forcing
errors, glitches, bugs, and other malfunctions, and then reimagine them in physical space.
Sound could be generated in a similar way and/or by using data derived from these errors as
parameters for sonification.
The second possible direction focuses on resources found in nature. I am particularly drawn
to working with water and its various states, especially ice. I have experimented with this in
the past by building a DIY hydrophone, which I placed in a container of water and then put
into a freezer. The results, however, were underwhelming. Although the hydrophone survived
the harsh testing, there was almost no noise or events to use as triggers as the ice melted.
Despite the initial test not being very successful, I still want to explore the sonification,
amplification, sculpting, and transformation of ice.
Another natural resource I am drawn to is trees, more specifically tree rings and tree bark. I
developed this concept during my previous studies, where we were tasked with creating our
own concept for a music algorithm. The idea was to study and collect data on how and why
tree rings are formed, and then generate digital tree rings whose parameters would
manipulate sound. Tree bark was intended to be used as a filter and a means of sound
categorization, based on its natural patterns.
While discussing the tree ring algorithm, I was reminded of another concept I created that
could also work well, the shushing room. This interactive sound installation would consist of
multiple devices, each equipped with its own microphone and speaker. When the incoming
signal exceeds a certain loudness threshold, the device would play a randomly selected
audio sample from a library of recordings of people saying “shhhh,” “shush,” “shssshsh,” and
similar sounds. The goal would be to create a kind of game through these interactions: when
a sample is triggered, the lights in the room would turn off, disorienting the audience and
encouraging them to be more mindful of the noise they produce.
Overall, I am currently gravitating toward the exploration of digital glitches and their
reimagination in physical space, however, I remain open to exploring other ideas as well.
