Virtual games help the blind navigate unknown territory

March 27, 2013

On March 27th JoVE will publish a new video article by Dr. Lotfi Merabet showing how researchers in the Department of Ophthalmology at Massachusetts Eye and Ear Infirmary and Harvard Medical School have developed a virtual gaming environment to help blind individuals improve navigation skills and develop a cognitive spatial map of unfamiliar buildings and public locations.

"For the blind, finding your way or navigating in a place that is unfamiliar presents a real challenge," Dr. Merabet explains. "As people with sight, we can capture sensory information through our eyes about our surroundings. For the blind that is a real challenge… the blind will typically use auditory and ."

This video is not supported by your browser at this time.
This video is Dr. Merabet's article as it appears in JoVE. Credit: Jove.com

The technique utilizes computer generated layouts of public buildings and spatial to synthesize a virtual world that mimics a real world navigation task. In the game, participants must find jewels and carry them out of the building, without being intercepted by roaming monsters that steal the jewels and hide them elsewhere. Participants interface with the virtual building by using a keyboard and wearing headphones that play auditory cues that help spatially orient them to the world around them. This interaction helps users generate an accurate mental layout of the mimicked building. Dr. Merabet and his colleagues are also exploring applications of this technology with other user interfaces, like a or joystick.

"We have developed software called ABES, the Audio Based Environment Simulator that represents the actual of the Carroll Center for the Blind in Newton Massachusetts. The participants will use the game metaphor to get a sense of the whole building through open discovery, allowing people to learn room layouts more naturally than if they were just following directions."

The technology will invariably be useful for the 285 million blind people world-wide, 6 million of which live in the United States. It will also have applications beyond the blind community for individuals with other visual impairments, cognitive deficits, or those recovering from brain injuries.

Dr. Merabet considers publication in JoVE's video format especially helpful. "It is conceptually difficult for a sighted person to understand 'a video game for blind people.' What JoVE allows us to do is break down layouts of the game and strategy, show how the can be used and how we quantify performance going from the virtual game to the physical world."

Explore further: Study shows vision is necessary for spatial awareness tasks

More information: Merabet et. al.; www.jove.com/video/50272/development-an-audio-based-virtual-gaming-environment-to-assist-with

Related Stories

Recommended for you

We've all got a blind spot, but it can be shrunk

August 31, 2015

You've probably never noticed, but the human eye includes an unavoidable blind spot. That's because the optic nerve that sends visual signals to the brain must pass through the retina, which creates a hole in that light-sensitive ...

Biologists identify mechanisms of embryonic wound repair

August 31, 2015

It's like something out of a science-fiction movie - time-lapse photography showing how wounds in embryos of fruit flies heal themselves. The images are not only real; they shed light on ways to improve wound recovery in ...

New 'Tissue Velcro' could help repair damaged hearts

August 28, 2015

Engineers at the University of Toronto just made assembling functional heart tissue as easy as fastening your shoes. The team has created a biocompatible scaffold that allows sheets of beating heart cells to snap together ...

Research identifies protein that regulates body clock

August 26, 2015

New research into circadian rhythms by researchers at the University of Toronto Mississauga shows that the GRK2 protein plays a major role in regulating the body's internal clock and points the way to remedies for jet lag ...

Fertilization discovery: Do sperm wield tiny harpoons?

August 26, 2015

Could the sperm harpoon the egg to facilitate fertilization? That's the intriguing possibility raised by the University of Virginia School of Medicine's discovery that a protein within the head of the sperm forms spiky filaments, ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.