Questions answered with the pupils of your eyes (w/ Video)

August 5, 2013
This is a still frame, depicting essentially the final frame of the movie, only that in the upper right the computation is still depicted. Credit: Current Biology, Stoll et al.

Patients who are otherwise completely unable to communicate can answer yes or no questions within seconds with the help of a simple system—consisting of just a laptop and camera—that measures nothing but the size of their pupils. The tool, described and demonstrated in Current Biology, a Cell Press publication, on August 5 takes advantage of changes in pupil size that naturally occur when people do mental arithmetic. It requires no specialized equipment or training at all.

The new pupil response system might not only help those who are severely motor-impaired communicate, but might also be extended to assessing the mental state of patients whose state of consciousness is unclear, the researchers say.

"It is remarkable that a as simple as the pupil has such a rich repertoire of responses that it can be used for a task as complex as communication," says Wolfgang Einhäuser of Philipps-Universität Marburg in Germany.

The researchers asked healthy people to solve a only when the correct answer to a yes or no question was shown to them on a screen. The mental load associated with solving that problem caused an automatic increase in pupil size, which the researchers showed they could measure and translate into an accurate answer to questions like "Are you 20 years old?"

They then tested out their pupil response algorithm on seven "typical" locked-in patients who had suffered following a stroke. In many cases, they were able to discern an answer based on pupil size alone.

"We find it remarkable that the system worked almost perfectly in all healthy and then could be transferred directly from them to the patients, with no need for training or parameter adjustment," Einhäuser says.

The video will load shortly
This is a demonstration of the system, setup, and first question. Top left: system as viewed from the outside, the user watches a computer screen, which is visible at the right end of the picture. Top right: view of stimulus presented on this screen. Bottom left: online analysis of pupil trace. Bottom right: operator screen, footage of the pupil (note that this video can be slightly lagging compared to the rest of the video for technical reasons). Audio track: question read out by the operator ("Is you name Josef?"), 5 s later the system reads out the first response option ("non" -- no), another 5 s later the system reads out the second response option ("oui" -- yes, which is correct in this case). Note that while the current system uses a head-mounted eye-tracker (the EyeSeeCam) for practical reasons, in principle any camera will do. Credit: Current Biology, Stoll et al.

While the system could still use improvement in terms of speed and accuracy, those are technical hurdles Einhäuser is confident they can readily overcome. Their measures of pupil response could already make an important difference for those who need it most.

"For patients with altered state of consciousness—those who are in a coma or other unresponsive state—any communication is a big step forward," he says.

Explore further: Looking at a photo of the sun also reduces the size of your pupils

More information: Current Biology Vol 23 No 15

Related Stories

The pupils are the windows to the mind

January 28, 2012

The eyes are the window into the soul -- or at least the mind, according to a new paper published in Perspectives on Psychological Science, a journal of the Association for Psychological Science. Measuring the diameter of ...

Pupil dilation reveals sexual orientation: study

August 6, 2012

There is a popular belief that sexual orientation can be revealed by pupil dilation to attractive people, yet until now there was no scientific evidence. For the first time, researchers at Cornell University used a specialized ...

Recommended for you

Placebo sweet spot for pain relief found in brain

October 27, 2016

Scientists have identified for the first time the region in the brain responsible for the "placebo effect" in pain relief, when a fake treatment actually results in substantial reduction of pain, according to new research ...

Team announces mapping of the mouse cortex in 3-D

October 27, 2016

The Allen Institute for Brain Science has completed the three-dimensional mapping of the mouse cortex as part of the Allen Mouse Common Coordinate Framework (CCF): a standardized spatial coordinate system for comparing many ...

Neuro chip records brain cell activity

October 26, 2016

Brain functions are controlled by millions of brain cells. However, in order to understand how the brain controls functions, such as simple reflexes or learning and memory, we must be able to record the activity of large ...

Can a brain-computer interface convert your thoughts to text?

October 25, 2016

Ever wonder what it would be like if a device could decode your thoughts into actual speech or written words? While this might enhance the capabilities of already existing speech interfaces with devices, it could be a potential ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.