Singing in the brain

Erin Gee is pursuing an MFA in Studio Arts at Concordia University. Credit: Concordia University

What does anger sound like? What music does sorrow imply? Human emotion is being given a new soundtrack thanks to an exciting new collaboration between art and neuroscience.

Concordia University researcher Erin Gee is taking feelings to a new level by tapping directly into the , delivering music powered purely by the human body and its emotions. Using data collected from physiological displays of emotion, Gee is creating a software and hardware system that incorporates a set of experimental musical instruments that will perform a symphony of sentiments.

This research could have significant therapeutic benefits for those who have difficulty expressing emotion. Individuals with autism disorders, for example, often struggle to understand the emotions of others. Gee's could be used to teach them how to identify feelings by externalising and exaggerating them into such forms as music.

Having developed strong research connections in Australia around the topic of human bodies and electronic voices, Gee, who is pursing a Master's of Fine Arts in Studio Arts, linked her work to that of neurophysiologist Vaughan Macefield at the University of Western Sydney.

Their process begins with inserting very fine microelectrode needles into a . This allows the researchers to eavesdrop on the subject's emotions by recording transmitted through a single neuron. Essentially, they are listening in on emitted directly from the brain through the nervous system. It's a less than inserting electrodes directly into the brain. To build a more accurate emotional map, blood flow, , sweat release and respiration are also recorded.

These signals, which paint an electronic picture of the subject's emotions, are fed into Gee's computer, where custom-made software converts them into a chorus of chimes and bells, creating a music literally composed by feelings.

Gee hopes to transform her research into an emotional symphony unlike any other attempted before. Actors – chosen as subjects for their expert abilities to manifest emotion on demand – will be attached to various sensors that monitor their bodies' reactions to emotion. On stage, they will perform an emotional score that will require them to summon a broad range of feelings. "It will be like seeing someone expertly playing their emotions, as one would play a cello," says Gee.

Now back at Concordia, Gee is working in close collaboration with Fine Arts technicians to produce the robotic musicians that will play this emotional symphony. The robots are based on the percussive, xylophone-like glockenspiel, which, she says "reflects the on/off nature of data itself."

Gee is looking forward to giving her robots their debut during a world premiere in Montreal next fall through chamber music organization Innovations en Concert. "Each performance will be truly unique," she says. "Our specialized musical instruments will allow the emotional state of performers to drive the musical composition." Thanks to Gee and her collaborators, audiences will soon know what happiness sounds like.

add to favorites email to friend print save as pdf

Related Stories

Recommended for you

What are the chances that your dad isn't your dad?

Apr 16, 2014

How confident are you that the man you call dad is really your biological father? If you believe some of the most commonly-quoted figures, you could be forgiven for not being very confident at all. But how ...

New technology that is revealing the science of chewing

Apr 15, 2014

CSIRO's 3D mastication modelling, demonstrated for the first time in Melbourne today, is starting to provide researchers with new understanding of how to reduce salt, sugar and fat in food products, as well ...

After skin cancer, removable model replaces real ear

Apr 11, 2014

(HealthDay)—During his 10-year struggle with basal cell carcinoma, Henry Fiorentini emerged minus his right ear, and minus the hearing that goes with it. The good news: Today, the 56-year-old IT programmer ...

Italy scraps ban on donor-assisted reproduction

Apr 09, 2014

Italy's Constitutional Court on Wednesday struck down a Catholic Church-backed ban against assisted reproduction with sperm or egg donors that has forced thousands of sterile couples to seek help abroad.

User comments