The impossible staircase in our heads: how we visualise the world around us

Artists, such as Escher, have often exploited the paradoxes that emerge when a 3D scene is depicted by means of a flat, two-dimensional picture. In Escher's famous picture 'Waterfall', for example, it is impossible to tell whether the start of the waterfall is above or below its base.

Paradoxes like this can be generated in a drawing, but it is not possible to create such a 3D structure. The illusion is possible because drawings of 3D scenes are inherently ambiguous, so there is no one-to-one relationship between the picture and 3D locations in space.

Most theories of 3D vision and how we represent space in our visual system assume that we generate a one-to-one 3D model of space in our brains, where each point in real space maps to a unique point in our model. However, there is an ongoing debate about whether this is really the case.

To test this idea, researchers at the University of Reading placed participants wearing a virtual reality headset in a virtual room in which they had to judge which of two objects was the nearest. On some occasions, the size of the room was increased four-fold - previous research by the team showed that participants fail to notice this expansion.

In this new study, the researchers found that people's judgement of the relative depth of objects depended on the order in which the objects were compared. Although the results are readily explained in relation to the expansion of the room, the participants had no idea that the room changed at any stage during the experiment. It is the properties of this stable perception that the experiment tested.

Dr. Andrew Glennerster from the University of Reading, who led the study, explains: "In the impossible staircase illusion, you cannot tell whether the back corner is higher or lower than the front one as it depends which route you take to get there. The same is true, we find, in our task. This means that our own internal representations of space must be rather like Escher's paradoxes, with no one-to-one relationship to real space."

"Even when the size of the room increases four-fold, people think they are in a stable room throughout the experiment. Their interpretation of the room does not update itself when the room itself changes.

"Does it make sense for their representation of the room to have 3D coordinates, as a proper staircase would? No - there is no way to write down the coordinates of the objects that could explain the judgements people made. Visual space - the internal representation - is much more like the paradoxical staircase than a physically realisable model."

More information: Svarverud E et al. A demonstration of ‘broken’ visual space. PLoS ONE 2012 (epub ahead of print).

Journal reference: PLoS ONE

Provided by Wellcome Trust