The healing potential of interactive art

August 5, 2014 by George Poonkhin Khut, The Conversation
The BrightHearts app showing heart rate visualisation. Credit: Sensorium Health Pty Ltd

There's a growing body of medical research into the use of multimedia and gaming technologies for such tasks as stroke rehabilitation and pain management.

I believe that aesthetics play an important but often unacknowledged role in this work. Beyond just making things look pretty, the look, sound, and behaviour of these interactive designs can have a significant impact on what and how we feel.

BrightHearts is a creative relaxation training app developed by Sensorium Health – the company I founded with fellow Sydney-based interaction designer Jason McDermott. It's designed to help people observe and regulate stress and relaxation responses.

The app measures and translates changes in heart rate into a colourful and calming interactive art experience. It was originally designed as part of a with Dr Angie Morrow, a staff specialist in brain injury at Sydney's Children's Hospital at Westmead.

From art gallery to app store

Biofeedback training is a way of teaching people to regulate aspects of their bodily functions by providing a real time representation of the function being measured. By observing this sensor-driven display, subjects can learn to sense and eventually influence the signal being measured.

The Heart Library Project. Credit: George Khut

I started working with biofeedback in 2002, excited about the possibilities for a new way of experiencing and interacting with our bodies. This work combined the "objectivity" of bio-medical sensing technologies with the meditative sensibilities of eastern body-mind practices and the evocative power of live electronic art and music.

In 2009, I piloted one of these works in a waiting area at St. Vincent's Public Hospital Darlinghurst in a project called the Heart Library Project. Visitors to this immersive, interactive exhibit explored connections between their breath, emotions and heart rate via a video image of themselves. This image was overlaid with colors and textures that changed according to subtle shifts in heart rate. After this they illustrated their experience using a body-map template to document the sensations, emotions and images they experienced during their interaction.

Since then I've continued my research into applications for interactive art in hospitals.

In 2011, I began the aforementioned collaboration with Dr Angie Morrow. We designed an interactive experience for children undergoing painful recurrent procedures such as injections, blood collection and central line changes. Anticipatory anxiety can be a serious problem for many children that can lead to significant distress, difficult behaviour and delays to clinic schedules.

The BrightHearts research project aims to evaluate the efficacy of our app for managing the pain and anxiety experienced by children during these procedures. The project will compare the reports from children using the BrightHearts biofeedback app compared to existing iPad-based distraction methods.

How the app works

Screenshots from BrightHearts app showing visualisation for slower heart rates (blue) and faster heart rates (red). The goal of the interaction is to voluntarily influence the diameter of the rings, and the colour of the background - moving from red to organge, yellow, green and blue (slowest). Credit: Sensorium Health Pty Ltd.

The BrightHearts app rewards decreases in the user's with colourful animated visuals and sound effects. It provides users with a tangible experience of connections between their mind and body and their capacity to regulate these interactions with their breathing and relaxation.

BrightHearts combines the principles of biofeedback interaction that have been in use since the 1970s with an "immersive" multimedia aesthetic that I've been working with for the past 12 years.

This approach takes a softer, more contemplative approach to visualisation than is usually associated with mobile games and information graphics. It's about designing for a more relaxed way of looking - seeing but and feeling - but not necessarily "reading" or counting.

The past decade has seen growing interest in the application of art and design in health and - and the important role that emotions, motivation and aesthetics play in human learning and recovery.

The best is definitely yet to come, but it is important to stress that this type of work will only become a reality in actual clinical practice - when there is a sufficient body of evidence-based research to confirm the effectiveness and viability of these approaches in clinic.

Explore further: Breathing new life into the yoga experience

Related Stories

Breathing new life into the yoga experience

July 18, 2014
A unique new architectural environment for people who practice yoga and meditation is planning to take this ancient discipline into the digital era.

App for headache sufferers shows success

July 29, 2014
A unique app that helps headache sufferers to record the severity and regularity of their pain is being used as part of a Griffith research study.

New mobile app provides faster, more accurate measurement of respiratory rate

June 19, 2014
A new mobile app developed by researchers at the Child & Family Research Institute (CFRI) at BC Children's Hospital and the University of British Columbia can measure respiratory rate in children roughly six times faster ...

Self-help app for anxiety goes global

March 11, 2014
Anxiety is one of the most common problems in health centres and counselling services. The chances are that in a group of 10 people, up to two will suffer from moderate to severe anxiety.

Recommended for you

Short-course treatment for combat-related PTSD offers expedited path to recovery

January 23, 2018
Symptoms of Post-Traumatic Stress Disorder (PTSD) can be debilitating and standard treatment can take months, often leaving those affected unable to work or care for their families. But, a new study demonstrated that many ...

Priming can negate stressful aspects of negative sporting environments, study finds

January 23, 2018
The scene is ubiquitous in sports: A coach yells at players, creating an environment where winning is the sole focus and mistakes are punished. New research from the University of Kansas shows that when participants find ...

Social and emotional skills linked to better student learning

January 23, 2018
Students with well-developed and adaptive social and emotional behaviours are most likely to excel in school, according to UNSW researchers in educational psychology.

Study of learning and memory problems in OCD helps young people unlock potential at school

January 22, 2018
Adolescents with obsessive-compulsive disorder (OCD) have widespread learning and memory problems, according to research published today. The findings have already been used to assist adolescents with OCD obtain the help ...

People with prosthetic arms less affected by common illusion

January 22, 2018
People with prosthetic arms or hands do not experience the "size-weight illusion" as strongly as other people, new research shows.

Intensive behavior therapy no better than conventional support in treating teenagers with antisocial behavior

January 19, 2018
Research led by UCL has found that intensive and costly multisystemic therapy is no better than conventional therapy in treating teenagers with moderate to severe antisocial behaviour.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.