With mind-reading speller, free-for-all conversations that are silent and still

June 28, 2012
Researchers have come up with a device that may enable people who are completely unable to speak or move at all to nevertheless manage unscripted back-and-forth conversation. The key to such silent and still communication is the first real-time, brain-scanning speller, according to the report published online on June 28 in Current Biology.

Researchers have come up with a device that may enable people who are completely unable to speak or move at all to nevertheless manage unscripted back-and-forth conversation. The key to such silent and still communication is the first real-time, brain-scanning speller, according to the report published online on June 28 in Current Biology.

The new technology builds on groundbreaking earlier uses of fMRI brain scans to assess consciousness in people described as being in an unconscious, vegetative state and to enable them to answer yes and no questions. fMRI (or ) is typically used for clinical and research purposes to track by measuring blood flow.

"The work of Adrian Owen and colleagues led me to wonder whether it might even become possible to use fMRI, , and appropriate experimental designs to freely encode thoughts, letter-by-letter, and therewith enable back-and-forth communication in the absence of ," said Bettina Sorger of Maastricht University in The Netherlands.

The video will load shortly
This video shows mental task-related brain activation patterns. Video (c) Current Biology

The new evidence shows that the answer to that thought question is yes. Sorger's team came up with a letter-encoding technique that requires almost no pre-training. Participants in their study voluntarily selected letters on a screen, which guided the letter encoding; for each specific character, participants were asked to perform a particular mental task for a set period of time. That produced 27 distinct corresponding to each letter of the alphabet and the equivalent of a space bar, which could be automatically decoded in real-time using newly developed data analysis methods.

In each communication experiment, participants held a mini-conversation consisting of two open questions and answers. Everyone the researchers tested was able to successfully produce answers within a single one-hour session.

The results substantially extend earlier uses of fMRI, which allowed individuals to answer the equivalent of multiple-choice questions having four or fewer possible answers, by enabling free-letter spelling. That could make all the difference for people who are completely paralyzed and unable to benefit from other means of alternative communication, Sorger says.

Ultimately, she says their goal is to transfer the fMRI technology they've developed to a more portable and affordable method for measuring blood flow, such as functional near-infrared spectroscopy (fNIRS).

Explore further: People control thoughts better when they see their brain activity: study

More information: Current Biology, July 24, 2012 print issue print issue. DOI:10.1016/j.cub.2012.05.022

Related Stories

Recommended for you

Memory replay prioritizes high-reward memories

February 12, 2016

Why do we remember some events, places and things, but not others? Our brains prioritize rewarding memories over others, and reinforce them by replaying them when we are at rest, according to new research from the University ...

Watching sensory information translate into behavior

February 12, 2016

It remains one of the most fundamental questions in neuroscience: How does the flood of sensory information—everything an animal touches, tastes, smells, sees, and hears—translate into behavior?

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.