Interaction in Sounddesign

For this first blog post, I had to step a bit outside my comfort zone because we’ve started collaborating with sound designers on a music interface. That alone is already an interesting project. For the first blog post we had to research on nime.com and I came across a study about agency and creativity in musical interaction for people living with dementia and cognitive decline. I find this topic really interesting, especially since it connects in some ways to what I’m considering exploring in my master’s thesis.

Bild von jotoya auf Pixabay

Agency and Creativity in Musical Interaction for those living with Dementia and Cognitive Decline

Dementia is an umbrella term for a range of progressive conditions that affect the brain. These conditions can cause challenges with memory, problem solving, cognitive function and decision making. For people living with dementia, musical interventions have been shown to support important aspects of life, such as the sense of self. Sustained engagement with music can have a positive impact despite these challenges.

In this context, agency refers to the sense of control or ownership an individual feels over their actions and the resulting consequences. It describes the experience of being the initiator of one’s actions rather than just responding to external direction.

For people living with dementia, agency is often considered to be diminished. In research, dementia is frequently approached through a biomedical deficit model that focuses primarily on the skills and memories a person has lost. This perspective can lead to the assumption that because language and memory are impaired, agency must also be lost. However, this connection is often taken for granted rather than critically examined.

As a consequence, people living with dementia are frequently viewed as passive participants in therapeutic activities and are often expected to engage only in relatively basic tasks. In the study referenced, for example, participants were limited to playing simple instruments such as percussion while following the lead of experts. This setup reflects and reinforces the assumption that their role is primarily responsive rather than self-directed.

Biomedical deficit model

The biomedical deficit model is a framework commonly used in dementia research that focuses primarily on the skills lost by individuals and the tasks they are no longer able to achieve. This model prioritizes the identification of cognitive impairments, such as challenges with memory, language and problem-solving.

This paper proposed and tested a procedural music platform called the “SliderBox”, which was specifically created for people living with dementia. The goal of the project was to allow people with dementia to go beyond basic interactions to create sound and provide tools that facilitate unguided musical experiences and enabling them to actively participate music activities.

Source: J. Pigrem, J. Christensen, A. McPherson, R. Timmers, L. de Witte, and J. MacRitchie

The Hardware: The SliderBox is an accessible MIDI controller made of wood, with eight analogue sliders and eight push-buttons. It provides multi-modal feedback through LED light strips and buttons to help guide the user.

Conclusion

Some participants were struggling when there were more then two possible actions. This also directly related to the engagement, whereas less people would engage with the prototype, when it had to many possible actions.

The researchers also observed that the SliderBox had a high engagement and lack of negative behaviors, showing the potential for those platforms.

In this experiment concludes that it is absolutely possible to facilitate engaging musical interactions that also foster agency and creativity for those with cognitive decline.

Sources

[1] J. Pigrem, J. Christensen, A. McPherson, R. Timmers, L. de Witte, and J. MacRitchie, ‘Agency and Creativity in Musical Interaction for those living with Dementia and Cognitive Decline’, in Proceedings of the International Conference on New Interfaces for Musical Expression, 2024, pp. 315–323.

#7 Decision fatigue

Update

Here’s a small update on the last blog post where I mentioned that elderly people don’t really use technology for entertainment. Some family members recently got a new TV and were complaining that Netflix is installed everywhere. I talked to them about it and they told me they don’t really understand why it’s there at all. They said they don’t need it and would rather just watch whatever is on TV something random, without having to think about it.

They also mentioned that on Netflix they often don’t even know what they would search for, which makes the whole experience feel unnecessary. With TV, something is always already playing. It feels like they just want to watch without having to decide first and the topic itself doesn’t matter that much. This is something i found quite interesting and will do some research on.

I beliefe this phenomenon might be explained by the following:

Reduced Processing Capacity and Cognitive Effort

  1. As individuals age, their available processing capacity and attentional resources decline, meaning they can process fewer discrete bits of information in a given time. [1]
    • Self-Initiated Processing: Digital entertainment often requires “self-initiated” processing, such as navigating complex menus or reorganising information in working memory, which shows substantial losses with age. [1]
    • Cognitive Load: If a digital interface is cluttered or complex, it demands high cognitive effort to navigate. When the effort required to make decisions within an app (such as choosing content or managing settings) exceeds the user’s available resources, it leads to frustration and a desire to stop using the technology. [2]

The Relationship Between Ease of Use and Usefulness

  1. For older adults, perceived usefulness is deeply linked to ease of use.
    • Immediate Benefits: Older adults are less likely to perceive a technology as useful if its benefits do not manifest easily and quickly during actual use. [3]
    • The “Visual Gymnastics” Effect: Users who have already spent a long day performing “visual gymnastics” to focus on digital content may find it harder to engage with non-standard or complex designs. If a digital entertainment platform requires unnecessary cognitive effort to understand its navigation, it disrupts the user’s mental model and erodes trust. [4]

Age Patterns in Entertainment Attitudes

  1. There is a pronounced age effect specifically regarding communication and entertainment devices (such as tablets and social networks), where positive attitudes towards them fall significantly as age increases. [3]
    • Significant Decline: Compared to those in their 50s, individuals aged 80+ are 47 to 48 percentage points less likely to value entertainment devices. [4]
    • Experience vs. Effort: This decline is partly attributed to older generations having less acquaintance and experience with these devices. Consequently, every interaction requires more “learning” effort, which can be exhausting, leading to a lower perception of the technology’s overall usefulness. [4]

Usability Barriers as a Deterrent

  1. Design flaws that increase decision-making friction directly impact perceived usefulness:
    • Navigation Issues: Confusing or cluttered navigation leads to hesitation and abandonment. [4]
    • Information Overload: Seniors are often more thorough in searching for information but are more prone to being distracted by irrelevant details and losing focus. [5]
    • Numeric and Spatial Fluence: A decline in numeracy can make it difficult for older adults to interpret data-heavy interfaces (like those found in complex gaming or streaming settings), further complicating their ability to see the technology as a “help” or “value”. [2]

Summary Table: Effort vs. Perceived Usefulness

BarrierImpact on Perceived Usefulness
Complex InterfacesIncreases cognitive load, leading to user errors and frustration.
Delayed RewardsIf benefits aren’t immediate, the user views the tool as cumbersome rather than useful.
Working Memory DeclineMakes active updating and navigation effortful and “costly” to carry out.
Lack of ConsistencyDisrupts mental models, causing hesitation and a loss of confidence.

Sources

[1] F. Craik, ‘Memory Changes in Normal Aging’, Current Directions in Psychological Science – CURR DIRECTIONS PSYCHOL SCI, vol. 3, pp. 155–158, 10 1994.

[2] G. A. Wildenbos, L. Peute, and M. Jaspers, “Aging barriers influencing mobile health usability for older adults: A literature based framework (MOLD-US),” International Journal of Medical Informatics, vol. 114, pp. 66–75, Jun. 2018, doi: https://doi.org/10.1016/j.ijmedinf.2018.03.012.

[3] N. Halmdienst, M. Radhuber, and R. Winter-Ebmer, “Attitudes of elderly Austrians towards new technologies: communication and entertainment versus health and support use,” European Journal of Ageing, vol. 16, no. 4, pp. 513–523, Apr. 2019, doi: https://doi.org/10.1007/s10433-019-00508-y.

[4] Thefinchdesignagency, “Building User Trust in UX Design: Proven Strategies for Better Engagement,” Medium, Feb. 05, 2025. https://medium.com/@thefinchdesignagency/building-user-trust-in-ux-design-proven-strategies-for-better-engagement-c975aa381516

[5] D. Orzeszek et al., ‘Beyond participatory design: Towards a model for teaching seniors application design’, arXiv preprint arXiv:1707. 05667, 2017.

#3 Testing and Research

Background

This week I had a situation that perfectly illustrated why I chose this topic. I was explaining some functionalities of a new app to my grandfather. He has always been very tech-savvy, he still works on his own website but even he struggles with certain concepts from time to time. He often tells me that everything takes him much longer than it used to and even when I show him a quicker or easier way to do something, he still sticks to the method he already knows. I believe this is partly a matter of habit and partly a reluctance to change something that “still works.”

What surprised me most was watching him interact with the app after my explanation. I assumed that once I had shown him how the app worked, it would be straightforward. But when he tried it on his own, he had to stop and ask for help at many points. It made me realize how much prior knowledge and digital literacy designers unconsciously expect from users, even when the interface seems simple to us.

This small moment showed exactly why designing for older adults matters: even motivated users with experience and interest in technology can struggle when interactions are not intuitive, forgiving or aligned with their mental models.

But here comes the real question: Is the problem rooted in the design of digital products or in the mental models that older adults bring with them? In other words, should we focus on improving the interfaces or on helping older people build the conceptual frameworks they need to understand how technology works in the first place?

Research

Problems older adults face with technology usually come from two sides: the design of the technology and the way older people understand and process information. When these two sides don’t match, it leads to confusion and mistakes. [1][3]

Many digital products simply aren’t designed with older adults in mind. This creates barriers that make technology hard to use.

  • Interfaces that feel cluttered or complicated: When apps have too many features or unclear layouts, older adults struggle to find what they need.[3]
  • Physical design that clashes with age-related changes: Small buttons, close-together touch targets or gestures like pinching and swiping can be difficult due to reduced vision, motor skills or dexterity.[3]
  • Unclear icons: Small, abstract or unfamiliar icons can be hard to recognize. Older adults often expect bigger, more descriptive labels instead of symbolic icons. [3]
  • Inconsistent design: If the interface doesn’t behave in predictable ways, it breaks the user’s expectations. This lowers trust and makes people feel unsure about what will happen next. [5]

(Planned) Sources

[1] D. Orzeszek et al., ‘Beyond Participatory Design: Towards a Model for Teaching Seniors Application Design’, arXiv [cs.CY]. 2017.

[2] L. Kane, “Usability for Seniors: Challenges and Changes,” Nielsen Norman Group, Sep. 08, 2019. https://www.nngroup.com/articles/usability-for-senior-citizens/

[3] G. A. Wildenbos, L. Peute, and M. Jaspers, ‘Aging barriers influencing mobile health usability for older adults: A literature based framework (MOLD-US)’, International Journal of Medical Informatics, vol. 114, pp. 66–75, 2018.

[4] J. Nielsen, “Usability for Senior Citizens: Improved, But Still Lacking,” Nielsen Norman Group, May 28, 2013. https://www.nngroup.com/articles/usability-seniors-improvements/

[5] Thefinchdesignagency, “Building User Trust in UX Design: Proven Strategies for Better Engagement,” Medium, Feb. 05, 2025. https://medium.com/@thefinchdesignagency/building-user-trust-in-ux-design-proven-strategies-for-better-engagement-c975aa381516