Singing in the brain

Erin Gee is pursuing an MFA in Studio Arts at Concordia University. Credit: Concordia University

What does anger sound like? What music does sorrow imply? Human emotion is being given a new soundtrack thanks to an exciting new collaboration between art and neuroscience.

Concordia University researcher Erin Gee is taking feelings to a new level by tapping directly into the , delivering music powered purely by the human body and its emotions. Using data collected from physiological displays of emotion, Gee is creating a software and hardware system that incorporates a set of experimental musical instruments that will perform a symphony of sentiments.

This research could have significant therapeutic benefits for those who have difficulty expressing emotion. Individuals with autism disorders, for example, often struggle to understand the emotions of others. Gee's could be used to teach them how to identify feelings by externalising and exaggerating them into such forms as music.

Having developed strong research connections in Australia around the topic of human bodies and electronic voices, Gee, who is pursing a Master's of Fine Arts in Studio Arts, linked her work to that of neurophysiologist Vaughan Macefield at the University of Western Sydney.

Their process begins with inserting very fine microelectrode needles into a . This allows the researchers to eavesdrop on the subject's emotions by recording transmitted through a single neuron. Essentially, they are listening in on emitted directly from the brain through the nervous system. It's a less than inserting electrodes directly into the brain. To build a more accurate emotional map, blood flow, , sweat release and respiration are also recorded.

These signals, which paint an electronic picture of the subject's emotions, are fed into Gee's computer, where custom-made software converts them into a chorus of chimes and bells, creating a music literally composed by feelings.

Gee hopes to transform her research into an emotional symphony unlike any other attempted before. Actors – chosen as subjects for their expert abilities to manifest emotion on demand – will be attached to various sensors that monitor their bodies' reactions to emotion. On stage, they will perform an emotional score that will require them to summon a broad range of feelings. "It will be like seeing someone expertly playing their emotions, as one would play a cello," says Gee.

Now back at Concordia, Gee is working in close collaboration with Fine Arts technicians to produce the robotic musicians that will play this emotional symphony. The robots are based on the percussive, xylophone-like glockenspiel, which, she says "reflects the on/off nature of data itself."

Gee is looking forward to giving her robots their debut during a world premiere in Montreal next fall through chamber music organization Innovations en Concert. "Each performance will be truly unique," she says. "Our specialized musical instruments will allow the emotional state of performers to drive the musical composition." Thanks to Gee and her collaborators, audiences will soon know what happiness sounds like.

add to favorites email to friend print save as pdf

Related Stories

Recommended for you

Were clinical trial practices in East Germany questionable?

Oct 23, 2014

Clinical trials carried out in the former East Germany in the second half of the 20th century were not always with the full knowledge or understanding of participants with some questionable practices taking place, according ...

Schumacher's doctor sees progress after injury

Oct 23, 2014

A French physician who treated Michael Schumacher for nearly six months after the Formula One champion struck his head in a ski accident says he is no longer in a coma and predicted a possible recovery within three years.

User comments