The healing potential of interactive art

August 5, 2014 by George Poonkhin Khut, The Conversation
The BrightHearts app showing heart rate visualisation. Credit: Sensorium Health Pty Ltd

There's a growing body of medical research into the use of multimedia and gaming technologies for such tasks as stroke rehabilitation and pain management.

I believe that aesthetics play an important but often unacknowledged role in this work. Beyond just making things look pretty, the look, sound, and behaviour of these interactive designs can have a significant impact on what and how we feel.

BrightHearts is a creative relaxation training app developed by Sensorium Health – the company I founded with fellow Sydney-based interaction designer Jason McDermott. It's designed to help people observe and regulate stress and relaxation responses.

The app measures and translates changes in heart rate into a colourful and calming interactive art experience. It was originally designed as part of a with Dr Angie Morrow, a staff specialist in brain injury at Sydney's Children's Hospital at Westmead.

From art gallery to app store

Biofeedback training is a way of teaching people to regulate aspects of their bodily functions by providing a real time representation of the function being measured. By observing this sensor-driven display, subjects can learn to sense and eventually influence the signal being measured.

The Heart Library Project. Credit: George Khut

I started working with biofeedback in 2002, excited about the possibilities for a new way of experiencing and interacting with our bodies. This work combined the "objectivity" of bio-medical sensing technologies with the meditative sensibilities of eastern body-mind practices and the evocative power of live electronic art and music.

In 2009, I piloted one of these works in a waiting area at St. Vincent's Public Hospital Darlinghurst in a project called the Heart Library Project. Visitors to this immersive, interactive exhibit explored connections between their breath, emotions and heart rate via a video image of themselves. This image was overlaid with colors and textures that changed according to subtle shifts in heart rate. After this they illustrated their experience using a body-map template to document the sensations, emotions and images they experienced during their interaction.

Since then I've continued my research into applications for interactive art in hospitals.

In 2011, I began the aforementioned collaboration with Dr Angie Morrow. We designed an interactive experience for children undergoing painful recurrent procedures such as injections, blood collection and central line changes. Anticipatory anxiety can be a serious problem for many children that can lead to significant distress, difficult behaviour and delays to clinic schedules.

The BrightHearts research project aims to evaluate the efficacy of our app for managing the pain and anxiety experienced by children during these procedures. The project will compare the reports from children using the BrightHearts biofeedback app compared to existing iPad-based distraction methods.

How the app works

Screenshots from BrightHearts app showing visualisation for slower heart rates (blue) and faster heart rates (red). The goal of the interaction is to voluntarily influence the diameter of the rings, and the colour of the background - moving from red to organge, yellow, green and blue (slowest). Credit: Sensorium Health Pty Ltd.

The BrightHearts app rewards decreases in the user's with colourful animated visuals and sound effects. It provides users with a tangible experience of connections between their mind and body and their capacity to regulate these interactions with their breathing and relaxation.

BrightHearts combines the principles of biofeedback interaction that have been in use since the 1970s with an "immersive" multimedia aesthetic that I've been working with for the past 12 years.

This approach takes a softer, more contemplative approach to visualisation than is usually associated with mobile games and information graphics. It's about designing for a more relaxed way of looking - seeing but and feeling - but not necessarily "reading" or counting.

The past decade has seen growing interest in the application of art and design in health and - and the important role that emotions, motivation and aesthetics play in human learning and recovery.

The best is definitely yet to come, but it is important to stress that this type of work will only become a reality in actual clinical practice - when there is a sufficient body of evidence-based research to confirm the effectiveness and viability of these approaches in clinic.

Explore further: Breathing new life into the yoga experience

Related Stories

Breathing new life into the yoga experience

July 18, 2014
A unique new architectural environment for people who practice yoga and meditation is planning to take this ancient discipline into the digital era.

App for headache sufferers shows success

July 29, 2014
A unique app that helps headache sufferers to record the severity and regularity of their pain is being used as part of a Griffith research study.

New mobile app provides faster, more accurate measurement of respiratory rate

June 19, 2014
A new mobile app developed by researchers at the Child & Family Research Institute (CFRI) at BC Children's Hospital and the University of British Columbia can measure respiratory rate in children roughly six times faster ...

Self-help app for anxiety goes global

March 11, 2014
Anxiety is one of the most common problems in health centres and counselling services. The chances are that in a group of 10 people, up to two will suffer from moderate to severe anxiety.

Recommended for you

Even babies can tell who's the boss, UW research says

July 27, 2017
The charismatic colleague, the natural leader, the life of the party - all are personal qualities that adults recognize instinctively. These socially dominant types, according to repeated studies, also tend to accomplish ...

DREAMers at greater risk for mental health distress

July 27, 2017
Immigrants who came to the United States illegally as small children and who meet the requirements of the Development Relief and Education for Alien Minors Act, more commonly known as DREAMers, are at risk for mental health ...

Infants know what we like best, study finds

July 27, 2017
Behind the chubby cheeks and bright eyes of babies as young as 8 months lies the smoothly whirring mind of a social statistician, logging our every move and making odds on what a person is most likely to do next, suggests ...

Negativity, be gone—new online tool can retrain your brain

July 27, 2017
Anxiety and depression can have devastating effects on people's lives. In some cases, the mental disorders lead to isolation, poverty and poor physical health, things that often cascade to future generations.

Research aims to shape more precise treatments for depression in women

July 27, 2017
Among women in the United States, depression is at epidemic levels: Approximately 12 million women in the U.S. experience clinical depression each year, and more than 12 percent of women can expect to experience depression ...

Very preterm birth not associated with mood and anxiety disorders, new research finds

July 27, 2017
Do very-preterm or very-low-weight babies develop anxiety and mood disorders later in life? Julia Jaekel, assistant professor of child and family studies at the University of Tennessee, Knoxville, and Dieter Wolke, professor ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.