Neuroscientist David Sulzer turns brain waves into music
From left, Brad Garton and David Sulzer discuss turning brain waves into music on WHYY/PBS in Philadelphia.
Columbia neurophysiologist David Sulzer took his first piano lessons at the age of 11 and was playing his violin and guitar in bars by age 15. Later he gained a national following as a founder of the Soldier String Quartet and the Thai Elephant Orchestra—an actual orchestra of elephants in northern Thailand—and for playing with the likes of Bo Diddley, the Velvet Underground's John Cale and the jazz great Tony Williams.
It was only after arriving at Columbia, however, that the musician-turned-research-scientist embarked on perhaps his most exotic musical venture—using a computer to translate the spontaneous patterns of his brain waves into music.
With the help of Brad Garton, director of Columbia's Computer Music Center, Sulzer has performed his avant-garde brain wave music in solo recitals and with musical ensembles.
Last spring, Sulzer presented a piece entitled Reading Stephen Colbert at a conference in New York City sponsored by Columbia and the Paris-based IRCAM (Institut de Recherche et Coordination Acoustique/Musique), a global center of musical research.
Sulzer, a professor in the departments of Psychiatry, Neurology and Pharmacology, wore electrodes attached to his scalp to measure voltage fluctuations in his brain as he sat in a chair reading a book by the comedian. Those fluctuations were fed into a computer program created by Garton, which transformed them into musical notes.
"I tried to forget I was in front of people and they could see my brain waves on a screen and listen to the music as I read the book," says Sulzer. "Luckily, the book was funny and I laughed, which changed the music."
The Brainwave Music Project grew out of an invitation in 2008 from the Graduate Center of the City University of New York to lecture on how the brain interprets rhythm. Sulzer, whose main research focus is the chemical transmission of brain signals and the neuroscience of neurological and psychiatric disorders, had heard about measurement of brain waves of drummers playing together using electroencephalography (EEG), a technique that measures electrical activity in the brain. The longer the drummers jammed, the more their brain waves began to synch up. Why not see if the musicians could use their own brain waves to make new music together?
Sulzer asked Garton, who had spent his younger years in New York's downtown music scene and had followed the neuroscientist's previous career with the Soldier String Quartet, if he knew a graduate student who might be interested in helping him develop software for his lecture. Garton volunteered to do it himself.
"I knew the digital synthesis and audio side of things, he had the knowledge of neurotechnology and brain waves—it was the perfect match," Garton says.
When brain cells are active, they communicate with the cells around them by emitting electrical spikes that vary in frequency and amplitude. A single sensory stimulus will cause a series of brain cells to fire, which will excite the cells around them and lead to a chain reaction of cell firings that ripple through the brain like the waves that ripple out from a pebble tossed into a pond.
"I take the signals, digitize them and then turn them into signals in the computer that control the sound," Garton says. "A project where you can make sound just by thinking about it is pretty cool. It's great fun."
Garton and Sulzer have tried a number of ways to make music from these waves. Sometimes they program specific musical notes to play every time the EEG sensors detect brain cells firing at specific frequencies or amplitudes. Other times, they assign an array of prerecorded sounds or notes to specific neural patterns.
Sulzer cautions against taking the project too seriously. It's more of a "didactic tool," he says, that he usually pairs with his pop science lectures on brainwaves and brain function or with Garton's on computerized music.
"Part of it is didactic, part of it is satirical," Sulzer says. "Sometimes I'm making fun of attitudes towards music. For instance, I'll say 'this shows you can be a conscious composer' because you can try to manipulate brain waves. Or you can be an unconscious composer. Reading Stephen Colbert is an example of that."
Sulzer is skeptical the technique will ever result in better music than that which the brain is already capable of producing through the tongue and fingers."Trying to play music using brain waves is like trying to play the piano using boxing gloves," he says. "The level of detail that the current brain scanning technology can pick up is simply too crude."
Provided by Columbia University
- The music of the (hemi)spheres sheds new light on schizophrenia May 09, 2012 | not rated yet | 0
- Guitarists' brains swing together (w/Video) Mar 17, 2009 | not rated yet | 0
- Babies' brains benefit from music lessons, researchers find May 09, 2012 | not rated yet | 0
- Listening to music can change the way you judge facial emotions May 06, 2009 | not rated yet | 0
- Neuroscientist: Think twice about cutting music in schools Feb 21, 2010 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
Why is zone 1 in liver more prone to ischemic injury?
May 23, 2013 Hi, Is it because around central vein, there is only deoxygenated blood from the vein where as in the periphery there is hepatic artery. Also why...
How can there be villous adenoma in colon, if there are no villi there
May 22, 2013 As title suggest. Thanks :smile:
How can there be a term called "intestinal metaplasia" of stomach
May 21, 2013 Hello everyone, Ok Stomach's normal epithelium is simple columnar, now in intestinal type of adenocarcinoma of stomach it undergoes "intestinal...
Pressure-volume curve: Elastic Recoil Pressure don't make sense
May 18, 2013 From pressure-volume curve of the lung and chest wall (attached photo), I don't understand why would the elastic recoil pressure of the lung is...
If you became brain-dead, would you want them to pull the plug?
May 17, 2013 I'd want the rest of me to stay alive. Sure it's a lousy way to live but it beats being all-the-way dead. Maybe if I make it 20 years they'll...
MRI bill question
May 15, 2013 Dear PFers, The hospital gave us a $12k bill for one MRI (head with contrast). The people I talked to at the hospital tell me that they do not...
- More from Physics Forums - Medical Sciences
More news stories
New research presented today shows that formation of new neurons in the hippocampus - a brain region known for its importance in learning and remembering - could cause forgetting of old memories by causing a reorganization ...
Neuroscience 20 hours ago | 4 / 5 (4) | 0
How can healthy people who hear voices help schizophrenics? Finding the answer for this is at the centre of research conducted at the University of Bergen.
Neuroscience 21 hours ago | 4 / 5 (2) | 2
One of the major frontiers of modern science is a comprehensive understanding of the human brain and its functions to guide the development of new technologies in information and communication. In a major announcement for ...
Neuroscience 21 hours ago | 3.7 / 5 (3) | 0
(Medical Xpress)—Regulating the distribution of power in neurons is done by a system that makes the national electric grid look simple by comparison. Each neuron has several thousand mitochondria confined ...
Neuroscience May 23, 2013 | 4.9 / 5 (9) | 0 |
(Medical Xpress)—The human brain is able to identify individuals' voices by comparing them against an internal 'average voice' prototype, according to neuroscientists.
Neuroscience May 23, 2013 | 3.7 / 5 (3) | 3 |
(Medical Xpress)—A new study by researchers in the US has shown that an ancient virus can be modified to help in the fight against the simian immunodeficiency virus SIV, which is the equivalent in monkeys ...
21 hours ago | 5 / 5 (3) | 0 |
Two mutations central to the development of infantile myofibromatosis (IM)—a disorder characterized by multiple tumors involving the skin, bone, and soft tissue—may provide new therapeutic targets, according to researchers ...
15 hours ago | 3 / 5 (2) | 0 |
Women at a particular stage in their monthly menstrual cycle may be more vulnerable to some of the psychological side-effects associated with stressful experiences, according to a study from UCL.
18 hours ago | 3.7 / 5 (3) | 0 |
A brief visual task can predict IQ, according to a new study. This surprisingly simple exercise measures the brain's unconscious ability to filter out visual movement. The study shows that individuals whose ...
May 23, 2013 | 4.6 / 5 (14) | 2 |
Biological processes are generally based on events at the molecular and cellular level. To understand what happens in the course of infections, diseases or normal bodily functions, scientists would need to ...
18 hours ago | 5 / 5 (5) | 0 |
Talking on a hands-free device while behind the wheel can lead to a sharp increase in errors that could imperil other drivers on the road, according to new research from the University of Alberta.
14 hours ago | not rated yet | 0