New research on the neural details of 'swiping'

New research on the neural details of 'swiping'
Sara Fabbri.

While observing fellow train passengers eagerly swiping their touch screens, neuroscientist Sara Fabbri got the idea to explore the neurocomputational basis of the swiping, tapping and pinching movements that people make when interacting with touch screen devices. For the next two years, she will work at the Donders Institute of Radboud University in the framework of the Radboud Excellence Initiative.

Sara Fabbri's research expertise is how the brain plans and executes reaching movements that allow us to interact with objects. At the Donders Institute for Brain, Cognition and Behaviour in Nijmegen, she will be the first to explore a completely new area of research: studying how the brain copes with movements people make while operating a touch screen.

'Most of the time, swiping movements don't have a clear goal', Fabbri explains regarding the special nature of these movements. 'You might be swiping towards something that is not visible on your screen yet, for instance when using a city map. Or you could be rotating a virtual 3D object like a globe by making movements on your touch screen in 2D. In the real world, there is a direct match between your perception of a target and the action that you take to reach that target. When using a touch screen, there sometimes is a mismatch between those pieces of information. The space on your screen is arbitrary, it does not necessarily relate to the . But your brain solves this mismatch automatically most of the time: working with touch screens is often intuitive. During my time at the Donders Institute, I want to find out how our brains represent the space we perceive on a touch screen and how we make plans to act upon that perception.'

Touch screens in the fMRI scanner

This video is not supported by your browser at this time.
Video 1: 'A Magazine Is an iPad That Does Not Work'

Touch screen devices are increasingly becoming part of our everyday life. However, Fabbri's research proposal constitutes the first attempt to find out how our brain deals with using them. One of her first projects in Nijmegen will be to compare how test subjects use city maps in real life and on devices. At this point in time, Fabbri's biggest challenge is a technical one: 'There are no commercial touch screens available yet that we can use inside the fMRI scanner, since they are all partly made out of metal. So first we have to find other ways to let people interact with touch screens while they are inside the scanner.'

New research on the neural details of 'swiping'
Fabbri map.

Future collaborations

New research on the neural details of 'swiping'
Fabbri globe.

Fabbri aims to set up several collaborations with researchers at Radboud University, for instance to develop computational models and to investigate a wide range of test subjects: from babies to the elderly. 'You can imagine that the brain of a teenager who is growing up surrounded by touch screens has a different way of handling these devices than the of somebody that only starting using them when they were fifty years old', she explains. With the knowledge she will gain, more user-friendly touch screens can be made. 'I'm very excited to get started and most of all very curious about the results. It's very exciting to work on something that nobody has ever investigated before!'

add to favorites email to friend print save as pdf

Related Stories

Stereolize creates a 234-inch touch screen (w/ video)

Mar 31, 2011

(PhysOrg.com) -- Touch screens are nothing new. The odds are that if you have a smart phone, then you probably have one in your pocket or purse right now. Have you ever seen one that is taller than you?

3-D Air-Touch display operates on mobile devices

Jan 30, 2014

(Phys.org) —While interactive 3D systems such as the Wii and Kinect have been popular for several years, 3D technology is yet to become part of mobile devices. Researchers are working on it, however, with ...

Recommended for you

New ALS associated gene identified using innovative strategy

9 hours ago

Using an innovative exome sequencing strategy, a team of international scientists led by John Landers, PhD, at the University of Massachusetts Medical School has shown that TUBA4A, the gene encoding the Tubulin Alpha 4A protein, ...

Can bariatric surgery lead to severe headache?

9 hours ago

Bariatric surgery may be a risk factor for a condition that causes severe headaches, according to a study published in the October 22, 2014, online issue of Neurology, the medical journal of the American Academy of Neurol ...

Bipolar disorder discovery at the nano level

9 hours ago

A nano-sized discovery by Northwestern Medicine scientists helps explain how bipolar disorder affects the brain and could one day lead to new drug therapies to treat the mental illness.

Brain simulation raises questions

13 hours ago

What does it mean to simulate the human brain? Why is it important to do so? And is it even possible to simulate the brain separately from the body it exists in? These questions are discussed in a new paper ...

Human skin cells reprogrammed directly into brain cells

13 hours ago

Scientists have described a way to convert human skin cells directly into a specific type of brain cell affected by Huntington's disease, an ultimately fatal neurodegenerative disorder. Unlike other techniques ...

User comments