Singing in the brain

September 26, 2012
Erin Gee is pursuing an MFA in Studio Arts at Concordia University. Credit: Concordia University

What does anger sound like? What music does sorrow imply? Human emotion is being given a new soundtrack thanks to an exciting new collaboration between art and neuroscience.

Concordia University researcher Erin Gee is taking feelings to a new level by tapping directly into the , delivering music powered purely by the human body and its emotions. Using data collected from physiological displays of emotion, Gee is creating a software and hardware system that incorporates a set of experimental musical instruments that will perform a symphony of sentiments.

This research could have significant therapeutic benefits for those who have difficulty expressing emotion. Individuals with autism disorders, for example, often struggle to understand the emotions of others. Gee's could be used to teach them how to identify feelings by externalising and exaggerating them into such forms as music.

Having developed strong research connections in Australia around the topic of human bodies and electronic voices, Gee, who is pursing a Master's of Fine Arts in Studio Arts, linked her work to that of neurophysiologist Vaughan Macefield at the University of Western Sydney.

Their process begins with inserting very fine microelectrode needles into a . This allows the researchers to eavesdrop on the subject's emotions by recording transmitted through a single neuron. Essentially, they are listening in on emitted directly from the brain through the nervous system. It's a less than inserting electrodes directly into the brain. To build a more accurate emotional map, blood flow, , sweat release and respiration are also recorded.

These signals, which paint an electronic picture of the subject's emotions, are fed into Gee's computer, where custom-made software converts them into a chorus of chimes and bells, creating a music literally composed by feelings.

Gee hopes to transform her research into an emotional symphony unlike any other attempted before. Actors – chosen as subjects for their expert abilities to manifest emotion on demand – will be attached to various sensors that monitor their bodies' reactions to emotion. On stage, they will perform an emotional score that will require them to summon a broad range of feelings. "It will be like seeing someone expertly playing their emotions, as one would play a cello," says Gee.

Now back at Concordia, Gee is working in close collaboration with Fine Arts technicians to produce the robotic musicians that will play this emotional symphony. The robots are based on the percussive, xylophone-like glockenspiel, which, she says "reflects the on/off nature of data itself."

Gee is looking forward to giving her robots their debut during a world premiere in Montreal next fall through chamber music organization Innovations en Concert. "Each performance will be truly unique," she says. "Our specialized musical instruments will allow the emotional state of performers to drive the musical composition." Thanks to Gee and her collaborators, audiences will soon know what happiness sounds like.

Explore further: Once again with feeling: Australian science tugs heart-strings

Related Stories

Once again with feeling: Australian science tugs heart-strings

August 23, 2012
Do humans really wear their hearts on their sleeve? An ambitious Australian neuroscience project aiming to translate emotional impulses directly into music is hoping to find out.

Understanding emotions without language

November 2, 2011
According to a new study by researchers from the MPI for Psycholinguistics and the MPI for Evolutionary Anthropology, you don't need to have words for emotions to understand them. The results of the study were published online ...

Recommended for you

Female researchers pay more attention to sex and gender in medicine

November 7, 2017
When women participate in a medical research paper, that research is more likely to take into account the differences between the way men and women react to diseases and treatments, according to a new study by Stanford researchers.

Drug therapy from lethal bacteria could reduce kidney transplant rejection

August 3, 2017
An experimental treatment derived from a potentially deadly microorganism may provide lifesaving help for kidney transplant patients, according to an international study led by investigators at Cedars-Sinai.

Exploring the potential of human echolocation

June 25, 2017
People who are visually impaired will often use a cane to feel out their surroundings. With training and practice, people can learn to use the pitch, loudness and timbre of echoes from the cane or other sounds to navigate ...

Team eradicates hepatitis C in 10 patients following lifesaving transplants from infected donors

April 30, 2017
Ten patients at Penn Medicine have been cured of the Hepatitis C virus (HCV) following lifesaving kidney transplants from deceased donors who were infected with the disease. The findings point to new strategies for increasing ...

'bench to bedside to bench': Scientists call for closer basic-clinical collaborations

March 24, 2017
In the era of genome sequencing, it's time to update the old "bench-to-bedside" shorthand for how basic research discoveries inform clinical practice, researchers from The Jackson Laboratory (JAX), National Human Genome Research ...

The ethics of tracking athletes' biometric data

January 18, 2017
(Medical Xpress)—Whether it is a FitBit or a heart rate monitor, biometric technologies have become household devices. Professional sports leagues use some of the most technologically advanced biodata tracking systems to ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.