Researchers measure how our brain reacts to Google Glass

August 11, 2016, Drexel University
The fNIR sensor, which is placed around the forehead like a headband, uses LEDs that shine near-infrared light to sample from 16 brain areas. Researchers use the technology to monitor oxygenation in the brain while the subject performs cognitive tasks. Credit: Drexel University

"Smart" eyewear—that can integrate augmented reality with your own, feed you live information about your surroundings and even be used in the operating room—is no longer the stuff of science fiction.

Wearable displays also have the potential to enhance cognitive ergonomics, or more simply, make it less mentally taxing to complete certain tasks. But before technologies like Google Glass become a part of daily life, engineers need a way to monitor exactly how they affect the brain in everyday situations.

At Drexel University, researchers have developed a portable system that can do just that. The system uses functional near-infrared spectroscopy, or fNIRS, to measure a person's .

The applications for fNIRS are seemingly endless—from training air traffic controllers and drone operators, to studying how students with disabilities learn best, or why different people are more receptive to certain Super Bowl commercials.

"This is a new trend called neuroergonomics. It's the study of the brain at work—cognitive neuroscience plus human factors," said Hasan Ayaz, PhD, associate research professor in the School of Biomedical Engineering, Science and Health Systems and a member of Drexel's CONQUER Collaborative. The phrase was coined by the late Raja Parasuraman, a former professor at George Mason University and study co-author.

Until now, most studies involving fNIRS took place indoors. Though participants wearing the system could move around freely while being monitored, they were still observed within laboratory confines.

A group of Drexel biomedical engineers, in collaboration with researchers at George Mason University, have now brought their portable fNIRS system "into the wild." In their study, published this summer in Frontiers in Human Neuroscience, the researchers successfully measured the brain activity of participants navigating a college campus outdoors.

The researchers wanted to compare one group of participants navigating campus with Google Glass to another group using Google Maps on an iPhone. Their goal was to measure mental workload (how hard the brain is working) and situation awareness (the perception of environmental elements), in order to see which device was less mentally taxing.

They found that overall, users using Google Glass had a higher situation awareness and lower mental workload than their peers navigating with an iPhone.

However, the researchers also found that users wearing Google Glass fell victim to "cognitive tunneling," meaning they focused so much more of their attention to the display itself, that they easily ignored other aspects of their surroundings.

"What we were able to see were the strengths and weaknesses of both. Now that we know we are able to capture that, we can now improve their design," said Ayaz, the study's principal investigator. "This opens up all new areas of applications. We will be able to analyze how the brain is functioning during all of these natural activities that you cannot replicate in artificial lab settings."

fNIRS is a way to measure oxygenation levels in the prefrontal cortex—the part of the brain responsible for complex behaviors like decision making, cognitive expression and personality development. Greater activity in this area of the brain signals that a person is a novice, and therefore must work harder, at an activity. When someone masters a skill, the processing of information moves toward the back regions of the brain.

In the past, researchers had to use secondary tasks to measure the "user-friendliness" of an product, like Google Glass. For instance, while a person was navigating with a maps application, they would be asked to recall a series of sounds played to them through headphones. If their responses were inaccurate, this implied that their brain had to work harder to pay attention to the primary task at hand.

For comparison, the Drexel researchers also used secondary tasks to measure mental workload and situation awareness. However, they found that these tasks were intrusive and ultimately unnecessary. The fNIRS system was able to accurately assess brain activity during the task and examine differences between a hand-held display and wearable display.

"We observed greater mental capacity reserves for head-mounted display users during ambulatory navigation based on behavioral and neuro-metabolic evidence. However, we also observed evidence that some of the advantages of head-mounted displays are overshadowed by their suboptimal display symbology, which can be overly attention grabbing," said Ryan McKendrick, PhD, the study's lead author and now a cognitive scientist at Northrop Grumman Corporation.

Since the research team found that Google Glass users experienced some cognitive tunneling while navigating, they suggest that future studies identify other biomarkers induced by this "blindness" to the outside world. By identifying cognitive tunneling biomarkers, engineers could "greatly advance display design for navigation, training and other tasks" that wearable displays are expected to enhance.

Explore further: Brain's prefrontal lobe is major player in Parkinson's Gait

More information: Ryan McKendrick et al, Into the Wild: Neuroergonomic Differentiation of Hand-Held and Augmented Reality Wearable Displays during Outdoor Navigation with Functional Near Infrared Spectroscopy, Frontiers in Human Neuroscience (2016). DOI: 10.3389/fnhum.2016.00216

Related Stories

Brain's prefrontal lobe is major player in Parkinson's Gait

August 10, 2016
A new study by Tel Aviv University researchers demonstrates that the prefrontal cortex, the part of the brain associated with cognitive functions, plays a major role in "Parkinson's Gait." It suggests a radically new understanding ...

Researchers publish first study of brain activation in MS using fNIRS

August 27, 2014
Using functional near infrared spectroscopy (fNIRS), Kessler Foundation researchers have shown differential brain activation patterns between people with multiple sclerosis (MS) and healthy controls. This is the first MS ...

New brain imaging technology offers new approach for studying Parkinsonian syndromes

December 18, 2015
Using a portable device developed at Drexel University, researchers at Albert Einstein College of Medicine have identified differences in brain activation patterns associated with postural stability in people with Parkinsonian ...

How your brain learns to ride the subway—and why AI developers care

May 18, 2016
In machine learning, a programmer might develop an AI that can calculate all possible consequences of a single action. Humans, however, don't have the same raw computational power; we have to efficiently create and execute ...

Study links physical activity to greater mental flexibility in older adults

August 24, 2015
One day soon, doctors may determine how physically active you are simply by imaging your brain. Physically fit people tend to have larger brain volumes and more intact white matter than their less-fit peers. Now a new study ...

Exercise may help keep an aging mind agile

September 21, 2015
(HealthDay)—Regular exercise may help seniors' minds stay as agile as their bodies, a new study finds.

Recommended for you

Scientists identify connection between dopamine and behavior related to pain and fear

April 19, 2018
Scientists at the University of Maryland School of Medicine have for the first time found direct causal links between the neurotransmitter dopamine and avoidance—behavior related to pain and fear.

Neurons derived from super-obese people respond differently to appetite hormones

April 19, 2018
US scientists have successfully generated hypothalamic-like neurons from human induced pluripotent stem cells (hiPSCs) taken from the blood and skin cells of super-obese individuals and people with a normal body weight. The ...

Pathways to spatial recognition

April 19, 2018
When you are lost or disoriented, your brain uses cues from your surroundings—landmarks both near and far—to sort out where you are. The information gathered by your senses is transmitted by nerve cells, or neurons, to ...

Researchers develop a new method to discover drugs to treat epilepsy

April 19, 2018
For more than a third of children living with epilepsy, the currently approved medications do not stop their seizures. This statistic has not changed for the past five decades, despite the development of many new anti-seizure ...

3-D human 'mini-brains' shed new light on genetic underpinnings of major mental illness

April 19, 2018
Major mental illnesses such as schizophrenia, severe depression and bipolar disorder share a common genetic link. Studies of specific families with a history of these types of illnesses have revealed that affected family ...

Study shows creativity is state of mind that can be trained

April 19, 2018
As an undergraduate student at York University, Joel Lopata was studying film production and jazz performance when a discrepancy became apparent.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.