Singing in the brain

September 26, 2012
Erin Gee is pursuing an MFA in Studio Arts at Concordia University. Credit: Concordia University

What does anger sound like? What music does sorrow imply? Human emotion is being given a new soundtrack thanks to an exciting new collaboration between art and neuroscience.

Concordia University researcher Erin Gee is taking feelings to a new level by tapping directly into the , delivering music powered purely by the human body and its emotions. Using data collected from physiological displays of emotion, Gee is creating a software and hardware system that incorporates a set of experimental musical instruments that will perform a symphony of sentiments.

This research could have significant therapeutic benefits for those who have difficulty expressing emotion. Individuals with autism disorders, for example, often struggle to understand the emotions of others. Gee's could be used to teach them how to identify feelings by externalising and exaggerating them into such forms as music.

Having developed strong research connections in Australia around the topic of human bodies and electronic voices, Gee, who is pursing a Master's of Fine Arts in Studio Arts, linked her work to that of neurophysiologist Vaughan Macefield at the University of Western Sydney.

Their process begins with inserting very fine microelectrode needles into a . This allows the researchers to eavesdrop on the subject's emotions by recording transmitted through a single neuron. Essentially, they are listening in on emitted directly from the brain through the nervous system. It's a less than inserting electrodes directly into the brain. To build a more accurate emotional map, blood flow, , sweat release and respiration are also recorded.

These signals, which paint an electronic picture of the subject's emotions, are fed into Gee's computer, where custom-made software converts them into a chorus of chimes and bells, creating a music literally composed by feelings.

Gee hopes to transform her research into an emotional symphony unlike any other attempted before. Actors – chosen as subjects for their expert abilities to manifest emotion on demand – will be attached to various sensors that monitor their bodies' reactions to emotion. On stage, they will perform an emotional score that will require them to summon a broad range of feelings. "It will be like seeing someone expertly playing their emotions, as one would play a cello," says Gee.

Now back at Concordia, Gee is working in close collaboration with Fine Arts technicians to produce the robotic musicians that will play this emotional symphony. The robots are based on the percussive, xylophone-like glockenspiel, which, she says "reflects the on/off nature of data itself."

Gee is looking forward to giving her robots their debut during a world premiere in Montreal next fall through chamber music organization Innovations en Concert. "Each performance will be truly unique," she says. "Our specialized musical instruments will allow the emotional state of performers to drive the musical composition." Thanks to Gee and her collaborators, audiences will soon know what happiness sounds like.

Explore further: Once again with feeling: Australian science tugs heart-strings

Related Stories

Understanding emotions without language

November 2, 2011

According to a new study by researchers from the MPI for Psycholinguistics and the MPI for Evolutionary Anthropology, you don't need to have words for emotions to understand them. The results of the study were published online ...

Recommended for you

The ethics of tracking athletes' biometric data

January 18, 2017

(Medical Xpress)—Whether it is a FitBit or a heart rate monitor, biometric technologies have become household devices. Professional sports leagues use some of the most technologically advanced biodata tracking systems to ...

Study shows blood products unaffected by drone trips

December 7, 2016

In what is believed to be the first proof-of-concept study of its kind, Johns Hopkins researchers have determined that large bags of blood products, such as those transfused into patients every day, can maintain temperature ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.