The healing potential of interactive art

August 5, 2014 by George Poonkhin Khut, The Conversation
The BrightHearts app showing heart rate visualisation. Credit: Sensorium Health Pty Ltd

There's a growing body of medical research into the use of multimedia and gaming technologies for such tasks as stroke rehabilitation and pain management.

I believe that aesthetics play an important but often unacknowledged role in this work. Beyond just making things look pretty, the look, sound, and behaviour of these interactive designs can have a significant impact on what and how we feel.

BrightHearts is a creative relaxation training app developed by Sensorium Health – the company I founded with fellow Sydney-based interaction designer Jason McDermott. It's designed to help people observe and regulate stress and relaxation responses.

The app measures and translates changes in heart rate into a colourful and calming interactive art experience. It was originally designed as part of a with Dr Angie Morrow, a staff specialist in brain injury at Sydney's Children's Hospital at Westmead.

From art gallery to app store

Biofeedback training is a way of teaching people to regulate aspects of their bodily functions by providing a real time representation of the function being measured. By observing this sensor-driven display, subjects can learn to sense and eventually influence the signal being measured.

The Heart Library Project. Credit: George Khut

I started working with biofeedback in 2002, excited about the possibilities for a new way of experiencing and interacting with our bodies. This work combined the "objectivity" of bio-medical sensing technologies with the meditative sensibilities of eastern body-mind practices and the evocative power of live electronic art and music.

In 2009, I piloted one of these works in a waiting area at St. Vincent's Public Hospital Darlinghurst in a project called the Heart Library Project. Visitors to this immersive, interactive exhibit explored connections between their breath, emotions and heart rate via a video image of themselves. This image was overlaid with colors and textures that changed according to subtle shifts in heart rate. After this they illustrated their experience using a body-map template to document the sensations, emotions and images they experienced during their interaction.

Since then I've continued my research into applications for interactive art in hospitals.

In 2011, I began the aforementioned collaboration with Dr Angie Morrow. We designed an interactive experience for children undergoing painful recurrent procedures such as injections, blood collection and central line changes. Anticipatory anxiety can be a serious problem for many children that can lead to significant distress, difficult behaviour and delays to clinic schedules.

The BrightHearts research project aims to evaluate the efficacy of our app for managing the pain and anxiety experienced by children during these procedures. The project will compare the reports from children using the BrightHearts biofeedback app compared to existing iPad-based distraction methods.

How the app works

Screenshots from BrightHearts app showing visualisation for slower heart rates (blue) and faster heart rates (red). The goal of the interaction is to voluntarily influence the diameter of the rings, and the colour of the background - moving from red to organge, yellow, green and blue (slowest). Credit: Sensorium Health Pty Ltd.

The BrightHearts app rewards decreases in the user's with colourful animated visuals and sound effects. It provides users with a tangible experience of connections between their mind and body and their capacity to regulate these interactions with their breathing and relaxation.

BrightHearts combines the principles of biofeedback interaction that have been in use since the 1970s with an "immersive" multimedia aesthetic that I've been working with for the past 12 years.

This approach takes a softer, more contemplative approach to visualisation than is usually associated with mobile games and information graphics. It's about designing for a more relaxed way of looking - seeing but and feeling - but not necessarily "reading" or counting.

The past decade has seen growing interest in the application of art and design in health and - and the important role that emotions, motivation and aesthetics play in human learning and recovery.

The best is definitely yet to come, but it is important to stress that this type of work will only become a reality in actual clinical practice - when there is a sufficient body of evidence-based research to confirm the effectiveness and viability of these approaches in clinic.

Explore further: Breathing new life into the yoga experience

Related Stories

App for headache sufferers shows success

July 29, 2014

A unique app that helps headache sufferers to record the severity and regularity of their pain is being used as part of a Griffith research study.

Self-help app for anxiety goes global

March 11, 2014

Anxiety is one of the most common problems in health centres and counselling services. The chances are that in a group of 10 people, up to two will suffer from moderate to severe anxiety.

Recommended for you

Study shows there's a positive side to worrying

April 27, 2017

Worry - it does a body good. And, the mind as well. A new paper by Kate Sweeny, psychology professor at the University of California, Riverside, argues there's an upside to worrying.

Study links cannabis use in adolescence to schizophrenia

April 26, 2017

Scientists believe that schizophrenia, a disorder caused by an imbalance in the brain's chemical reactions, is triggered by a genetic interaction with environmental factors. A new Tel Aviv University study published in Human ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.