Virtual games help the blind navigate unknown territory

March 27, 2013

On March 27th JoVE will publish a new video article by Dr. Lotfi Merabet showing how researchers in the Department of Ophthalmology at Massachusetts Eye and Ear Infirmary and Harvard Medical School have developed a virtual gaming environment to help blind individuals improve navigation skills and develop a cognitive spatial map of unfamiliar buildings and public locations.

"For the blind, finding your way or navigating in a place that is unfamiliar presents a real challenge," Dr. Merabet explains. "As people with sight, we can capture sensory information through our eyes about our surroundings. For the blind that is a real challenge… the blind will typically use auditory and ."

The video will load shortly
This video is Dr. Merabet's article as it appears in JoVE. Credit: Jove.com

The technique utilizes computer generated layouts of public buildings and spatial to synthesize a virtual world that mimics a real world navigation task. In the game, participants must find jewels and carry them out of the building, without being intercepted by roaming monsters that steal the jewels and hide them elsewhere. Participants interface with the virtual building by using a keyboard and wearing headphones that play auditory cues that help spatially orient them to the world around them. This interaction helps users generate an accurate mental layout of the mimicked building. Dr. Merabet and his colleagues are also exploring applications of this technology with other user interfaces, like a or joystick.

"We have developed software called ABES, the Audio Based Environment Simulator that represents the actual of the Carroll Center for the Blind in Newton Massachusetts. The participants will use the game metaphor to get a sense of the whole building through open discovery, allowing people to learn room layouts more naturally than if they were just following directions."

The technology will invariably be useful for the 285 million blind people world-wide, 6 million of which live in the United States. It will also have applications beyond the blind community for individuals with other visual impairments, cognitive deficits, or those recovering from brain injuries.

Dr. Merabet considers publication in JoVE's video format especially helpful. "It is conceptually difficult for a sighted person to understand 'a video game for blind people.' What JoVE allows us to do is break down layouts of the game and strategy, show how the can be used and how we quantify performance going from the virtual game to the physical world."

Explore further: Study of congenital, acquired blindness reveals new understanding of brain's early spatial development

More information: Merabet et. al.; www.jove.com/video/50272/devel … nment-to-assist-with

Related Stories

Study of congenital, acquired blindness reveals new understanding of brain's early spatial development

January 11, 2013
(Medical Xpress)—Researchers at the University of Bath have uncovered a new understanding of how the brain develops its sense of space by working with blind people.

Study shows vision is necessary for spatial awareness tasks

March 21, 2012
(Medical Xpress) -- People who lose their sight at a later stage in life have a greater spatial awareness than if they were born blind, according to scientists at Queen Mary, University of London.

Recommended for you

Want to win at sports? Take a cue from these mighty mice

July 20, 2017
As student athletes hit training fields this summer to gain the competitive edge, a new study shows how the experiences of a tiny mouse can put them on the path to winning.

'Smart' robot technology could give stroke rehab a boost

July 19, 2017
Scientists say they have developed a "smart" robotic harness that might make it easier for people to learn to walk again after a stroke or spinal cord injury.

Engineered liver tissue expands after transplant

July 19, 2017
Many diseases, including cirrhosis and hepatitis, can lead to liver failure. More than 17,000 Americans suffering from these diseases are now waiting for liver transplants, but significantly fewer livers are available.

Lunatic Fringe gene plays key role in the renewable brain

July 19, 2017
The discovery that the brain can generate new cells - about 700 new neurons each day - has triggered investigations to uncover how this process is regulated. Researchers at Baylor College of Medicine and Jan and Dan Duncan ...

New animal models for hepatitis C could pave the way for a vaccine

July 19, 2017
They say that an ounce of prevention is worth a pound of cure. In the case of hepatitis C—a disease that affects nearly 71 million people worldwide, causing cirrhosis and liver cancer if left untreated—it might be worth ...

Omega-3 fatty acids fight inflammation via cannabinoids

July 18, 2017
Chemical compounds called cannabinoids are found in marijuana and also are produced naturally in the body from omega-3 fatty acids. A well-known cannabinoid in marijuana, tetrahydrocannabinol, is responsible for some of its ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.