Questions answered with the pupils of your eyes (w/ Video)

August 5, 2013
This is a still frame, depicting essentially the final frame of the movie, only that in the upper right the computation is still depicted. Credit: Current Biology, Stoll et al.

Patients who are otherwise completely unable to communicate can answer yes or no questions within seconds with the help of a simple system—consisting of just a laptop and camera—that measures nothing but the size of their pupils. The tool, described and demonstrated in Current Biology, a Cell Press publication, on August 5 takes advantage of changes in pupil size that naturally occur when people do mental arithmetic. It requires no specialized equipment or training at all.

The new pupil response system might not only help those who are severely motor-impaired communicate, but might also be extended to assessing the mental state of patients whose state of consciousness is unclear, the researchers say.

"It is remarkable that a as simple as the pupil has such a rich repertoire of responses that it can be used for a task as complex as communication," says Wolfgang Einhäuser of Philipps-Universität Marburg in Germany.

The researchers asked healthy people to solve a only when the correct answer to a yes or no question was shown to them on a screen. The mental load associated with solving that problem caused an automatic increase in pupil size, which the researchers showed they could measure and translate into an accurate answer to questions like "Are you 20 years old?"

They then tested out their pupil response algorithm on seven "typical" locked-in patients who had suffered following a stroke. In many cases, they were able to discern an answer based on pupil size alone.

"We find it remarkable that the system worked almost perfectly in all healthy and then could be transferred directly from them to the patients, with no need for training or parameter adjustment," Einhäuser says.

The video will load shortly
This is a demonstration of the system, setup, and first question. Top left: system as viewed from the outside, the user watches a computer screen, which is visible at the right end of the picture. Top right: view of stimulus presented on this screen. Bottom left: online analysis of pupil trace. Bottom right: operator screen, footage of the pupil (note that this video can be slightly lagging compared to the rest of the video for technical reasons). Audio track: question read out by the operator ("Is you name Josef?"), 5 s later the system reads out the first response option ("non" -- no), another 5 s later the system reads out the second response option ("oui" -- yes, which is correct in this case). Note that while the current system uses a head-mounted eye-tracker (the EyeSeeCam) for practical reasons, in principle any camera will do. Credit: Current Biology, Stoll et al.

While the system could still use improvement in terms of speed and accuracy, those are technical hurdles Einhäuser is confident they can readily overcome. Their measures of pupil response could already make an important difference for those who need it most.

"For patients with altered state of consciousness—those who are in a coma or other unresponsive state—any communication is a big step forward," he says.

Explore further: Looking at a photo of the sun also reduces the size of your pupils

More information: Current Biology Vol 23 No 15

Related Stories

The pupils are the windows to the mind

January 28, 2012

The eyes are the window into the soul -- or at least the mind, according to a new paper published in Perspectives on Psychological Science, a journal of the Association for Psychological Science. Measuring the diameter of ...

Pupil dilation reveals sexual orientation: study

August 6, 2012

There is a popular belief that sexual orientation can be revealed by pupil dilation to attractive people, yet until now there was no scientific evidence. For the first time, researchers at Cornell University used a specialized ...

Recommended for you

Rat brain atlas provides MR images for stereotaxic surgery

October 21, 2016

Boris Odintsov, senior research scientist at the Biomedical Imaging Center at the Beckman Institute for Advanced Science and Technology at the University of Illinois in Urbana-Champaign, and Thomas Brozoski, research professor ...

ALS study reveals role of RNA-binding proteins

October 20, 2016

Although only 10 percent of amyotrophic lateral sclerosis (ALS) cases are hereditary, a significant number of them are caused by mutations that affect proteins that bind RNA, a type of genetic material. University of California ...

Imaging technique maps serotonin activity in living brains

October 20, 2016

Serotonin is a neurotransmitter that's partly responsible for feelings of happiness and for mood regulation in humans. This makes it a common target for antidepressants, which block serotonin from being reabsorbed by neurons ...

Overcoming egocentricity increases self-control

October 19, 2016

Neurobiological models of self-control usually focus on brain mechanisms involved in impulse control and emotion regulation. Recent research at the University of Zurich shows that the mechanism for overcoming egocentricity ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.