Audiovisual systems are often built on rules. In many live visuals, animations follow amplitude, brightness responds to frequency, and rhythm maps directly to motion. These mappings feel intuitive and readable, especially in environments such as clubs or concerts where immediacy is crucial. Rule-based systems allow designers to translate sound into visuals efficiently, creating coherence and predictability in complex sensory environments.
However, this reliance on synchrony also introduces a limitation. When audiovisual systems consistently reinforce what is already present in the sound, they risk becoming illustrative rather than expressive. Sound is no longer interpreted, but mirrored. Over time, these conventions solidify into expectations: a bass drop must explode visually, intensity must equal brightness, silence must equal darkness. At this point, the system no longer produces meaning, but confirms it.
This is where breaking the system becomes not a failure, but a design strategy.
Theorists of film sound have long argued that sound does not need to align with image to be effective. Michel Chion describes how sound can function as an independent narrative force, shaping perception even when it contradicts what is seen. Rather than redundancy, disjunction creates tension, ambiguity and emotional depth. This principle extends beyond cinema into audiovisual performance and live visual systems.
A clear example of this can be found in the film Dunkirk (2017), where sound and image deliberately resist synchronization. The persistent ticking motif in the soundtrack does not correspond to visible clocks or actions, yet it dominates the viewer’s bodily perception of time. Moments of visual stillness are accompanied by intense sonic pressure, while moments of action are sometimes stripped of musical emphasis. The result is not confusion, but heightened immersion. Sound does not explain the image; it destabilizes it. The film feels alive precisely because its audiovisual system refuses to resolve into a single, coherent rhythm.
In live audiovisual contexts, similar effects emerge when systems are designed to allow contradiction. Calm visuals beneath aggressive sound, delayed reactions, or moments where visuals remain unchanged despite sonic escalation all interrupt expectation. In these moments, sound effectively “lies.” It suggests one emotional direction while the image proposes another. Rather than canceling each other out, these competing signals produce a third layer of meaning that the audience must actively negotiate.
This negotiation is crucial. When systems behave exactly as expected, audiences can disengage perceptually while remaining physically present. When a system breaks its own rules, attention is reactivated. The audience becomes aware of the audiovisual relationship as something constructed and contingent. This awareness does not diminish immersion; it often deepens it by introducing tension and unpredictability.
Importantly, breaking rules only works when rules exist in the first place. A system provides orientation; deviation creates emphasis. Silence has power only when sound is anticipated. Stillness is expressive only when movement has been established. From this perspective, systems and their disruption are not opposites, but interdependent design elements.
This leads to a stronger design claim: audiovisual systems should not aim for perfect synchronization, but for expressive flexibility. Rather than asking how accurately visuals can follow sound, designers might ask when visuals should resist, lag behind or remain indifferent to sonic cues. Such resistance introduces friction, and friction is often what makes an experience feel alive.
For practice-based audiovisual design, this reframes error and failure. A visual response that appears “incorrect” within a system may generate more meaning than a technically flawless reaction. Especially in live contexts, moments of breakdown can signal presence, risk and authorship. They remind the audience that the system is being performed, not executed.
Ultimately, liveliness in audiovisual work does not emerge from control alone. It emerges in the unstable space between structure and rupture. Designing systems that can be bent, contradicted or temporarily broken allows audiovisual experiences to move beyond automation and toward expression. In this space, sound and image do not simply align.
THEY ARGUE.
THEY HESITATE.
THEY COLLIDE.
And it is precisely there that they begin to feel alive.
Sources:
Chion, M. (1994). Audio-vision: Sound on screen. Columbia University Press.
Chion, M. (2009). Film, a sound art. Columbia University Press.
Karlin, F., & Wright, R. (2004). On the track: A guide to contemporary film scoring (2nd ed.). Routledge.
Lehman, F. (2018). Hollywood harmony: Musical wonder and the sound of cinema. Oxford University Press.
