Identifying people by their bodies when faces are no help

October 3, 2013, Association for Psychological Science
This figure demonstrates photographs that lack sufficient information in the faces to distinguish them. Face-recognition software failed to identify correctly. The top two photos are of the same person, while the bottom two photos are of different people. Credit: University of Texas at Dallas

Every day we recognize friends, family, and co-workers from afar—even before we can distinctly see a face. New research reveals that when facial features are difficult to make out, we readily use information about someone's body to identify them—even when we don't know we're doing so.

"Psychologists and computer scientists have concentrated almost exclusively on the role of the face in person recognition," explains lead researcher, Allyson Rice of the University of Texas at Dallas. "But our results show that the body can also provide important and useful identity information for person recognition."

The new findings are published in Psychological Science, a journal of the Association for Psychological Science.

In several experiments, the researchers had college-age look at images of two people side by side and identify whether the images showed the same person or different people. Some of the image pairs looked very similar even though they actually showed different people, while other image pairs looked very different even though the pictures showed the same person.

The image pairs were chosen this way so that the information provided by the subjects' faces was ambiguous and not very helpful in determining the subjects' identity, based on a computer face recognition system's performance with these image pairs. The researchers edited the pictures in several of the experiments, omitting the subjects' bodies or faces to determine which features were most important for successful identification.

Overall, participants were able to accurately discern whether the images showed the same person when they were provided complete images. And participants were as accurate in identifying image pairs in which the faces were blocked out and only the bodies were shown.

But accuracy dropped off when participants saw images that included the subjects' faces but not their bodies. Surprisingly, seeing the subjects' bodies seemed to increase their accuracy in identifying the subjects.

Participants stated afterward that they used the nose, face shape, ears, mouth, and eyes as tools for identifying even though their results suggested otherwise.

"This left us with a paradox," the researchers write. "The recognition data clearly indicated the use of body information for identification. However, the subjective ratings suggested that participants were unaware of how important the body was in their decision."

To unravel the paradox, the researchers used eye-tracking equipment to determine where participants were actually looking while identifying the images, and the resulting data were clear: Participants spent relatively more time looking at the body when the face did not provide enough information to identify the subjects.

"Eye movements revealed a highly efficient and adaptive strategy for finding the most useful identity information in any given image of a person," Rice explains.

By showing that humans don't just rely on faces to identify others, this study opens up new avenues for developing and refining computer-based recognition systems.

"These systems are employed currently in law enforcement and security settings, but they sometimes fail when the quality of the facial image is poor," says Rice.

Rice, a newly graduated student in psychology and criminology, conducted this new research with Prof. Alice O'Toole at The University of Texas at Dallas. The UT Dallas research team has been collaborating with researcher Jonathon Phillips and others at the National Institute of Standards and Technology (NIST) in examining how humans and computers stack up when it comes to recognizing and people. Every couple of years, NIST organizes an international competition for computer-based face recognition systems, introducing increasingly difficult problems.

"We will continue comparing humans to machines on these new challenges," says O'Toole. "By looking at the way computer systems work, we often learn new and surprising things about the way humans recognize other people."

Explore further: Face identification accuracy is in the eye and brain of the beholder, researchers say

More information: pss.sagepub.com/content/early/ … 97613492986.abstract

Related Stories

Face identification accuracy is in the eye and brain of the beholder, researchers say

July 24, 2013
Though humans generally have a tendency to look at a region just below the eyes and above the nose toward the midline when first identifying another person, a small subset of people tend to look further down –– at the ...

'Seeing' faces through touch

September 4, 2013
Our sense of touch can contribute to our ability to perceive faces, according to new research published in Psychological Science, a journal of the Association for Psychological Science.

New research about facial recognition turns common wisdom on its head

March 19, 2012
(Medical Xpress) -- A team of researchers that includes a USC scientist has methodically demonstrated that a face's features or constituents – more than the face per se – are the key to recognizing a person.

In recognizing faces, the whole is not greater than the sum of its parts

March 9, 2012
(Medical Xpress) -- How do we recognize a face? To date, most research has answered “holistically”: We look at all the features—eyes, nose, mouth—simultaneously and, perceiving the relationships among ...

Recommended for you

Linguistic red flags from Facebook posts can predict future depression diagnoses

October 15, 2018
In any given year, depression affects more than 6 percent of the adult population in the United States—some 16 million people—but fewer than half receive the treatment they need. What if an algorithm could scan social ...

Study suggests biological basis for depression, anxiety, sleep disturbances in older adults

October 15, 2018
UC San Francisco researchers, in collaboration with the unique Brazilian Biobank for Aging Studies (BBAS) at the University of São Paulo, have shown that the earliest stages of the brain degeneration associated with Alzheimer's ...

Early changes to synapse gene regulation may cause Alzheimer's disease

October 15, 2018
Alzheimer's disease (AD) is the most common form of dementia, involving memory loss and a reduction in cognitive abilities. Patients with AD develop multiple abnormal protein structures in their brains that are thought to ...

Clues that suggest people are lying may be deceptive, study shows

October 12, 2018
The verbal and physical signs of lying are harder to detect than people believe, a study suggests.

How to avoid raising a materialistic child

October 12, 2018
If you're a parent, you may be concerned that materialism among children has been on the rise. According to research, materialism has been linked to a variety of mental health problems, such as anxiety and depression, as ...

The long-term effects of maternal high-fat diets

October 12, 2018
If a mother eats a high-fat diet, this can have a negative effect on the health of her offspring—right down to her great-grandchildren. This is the conclusion drawn by researchers at ETH Zurich from a study with mice.

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.