A gender-biased metric guides funding decisions in psychology research

January 13, 2012 By Divya Menon

How do psychologists gauge scientific impact? One way is the so-called “journal impact factor,” or JIF, a ranking of a journal derived from the number of citations by other authors to all of the articles it has published in a given year. But JIF isn’t just a statistical abstraction. “JIFs are increasingly used to assess and predict the merits of academic work,” which leads to decisions about hiring, promotion, and the allocation of scarce resources to researchers, says University of Surrey psychologist Peter Hegarty.

Needless to say, such a consequential measure must be as fair as possible. But JIF isn’t, say Hegarty and Surrey colleague Zoe Walton in a new article in Perspectives on Psychological Science, a journal published by the Association for Psychological Science. “Using JIF underestimates the impact of women researchers relative to men and the social science area relative to the natural science areas of psychology,” says Hegarty. For these reasons, the authors recommend administrators employ JIF “with caution.”

Hegarty and Walton performed a statistical analysis to assess whether JIF is the only, or even the best, way to predict which articles in leading psychology journals will garner the most citations—a number they got using the PsycINFO database. They sampled one issue published from 1996 through 2005 in each of nine high-impact psychology journals, which together represent nine sub-disciplines of psychology—1,133 articles in all. Their analysis included the sex of the first author; the number of pages, authors, and references, and the density of tables and graphs in the articles.  They asked which of these factors predicted citations in the five years following publication?

Along with JIF’s underestimation of citations to articles published by women psychologists, Hegarty and Walton found that articles that are longer, have more authors, and cite more references are themselves more frequently cited in turn.

The authors think there’s a link between the statistical slighting of papers authored by women in psychology and of those papers published in the social science areas of psychology: Women are better represented in those sub-disciplines and therefore published more often in such journals as the Journal of Personality and Social Psychology and Developmental Psychology. Men authors, meanwhile, currently predominate in experimental psychology and appear, for example, in the Journal of Cognitive Neuroscience.

It’s one complexity of a discipline that “straddles the natural and social sciences and is also a field of practice and application,” as well as theory and observation, says Hegarty, suggesting that measures of impact within psychology must be sensitive enough to account for the field’s complexity.

“Especially when you are using citation counts as a proxy for merit,” he says, “it is important to clarify the definition of academic merit. You want to make sure that the measure is not driving the definition of merit rather than the other way around.”

Explore further: Sexism and gender inequality

Related Stories

Sexism and gender inequality

October 28, 2011
(Medical Xpress) -- Individual beliefs don’t stay confined to the person who has them; they can affect how a society functions. A new study published in Psychological Science, a journal of the Association for Psychological ...

A call for an evolved understanding of emotion

January 4, 2012
(Medical Xpress) -- Many scientists believe that all people experience and express the same biologically “basic” emotions — an idea they have attributed to evolutionist Charles Darwin and one that has shaped ...

Meta-analysis helps psychologists build knowledge

January 9, 2012
(Medical Xpress) -- When scientists want to know the answer to a question that’s been studied a great deal, they conduct something called a meta-analysis, pooling data from multiple studies to arrive at one combined ...

A new discipline emerges: The psychology of science

October 19, 2011
You've heard of the history of science, the philosophy of science, maybe even the sociology of science. But how about the psychology of science? In a new article in Current Directions in Psychological Science, a journal published ...

Women, men and the bedroom

October 14, 2011
(Medical Xpress) -- In the racy television hit show, Sex and the City, Carrie, one of the main characters tells her best girlfriends that "Men who are too good looking are never good in bed because they never had to be." ...

Are sex offenders and lads' mags using the same language?

December 8, 2011
(Medical Xpress) -- Psychologists from Middlesex University and the University of Surrey found that when presented with descriptions of women taken from lads’ mags, and comments about women made by convicted rapists, ...

Recommended for you

Visual clues we use during walking and when we use them

July 25, 2017
(Medical Xpress)—A trio of researchers with the University of Texas and Rensselaer Polytechnic Institute has discovered which phase of visual information processing during human walking is used most to guide the feet accurately. ...

Toddlers begin learning rules of reading, writing at very early age, study finds

July 25, 2017
Even the proudest of parents may struggle to find some semblance of meaning behind the seemingly random mish-mash of letters that often emerge from a toddler's first scribbled and scrawled attempts at putting words on paper.

Psychopaths are better at learning to lie, say researchers

July 25, 2017
Individuals with high levels of psychopathic traits are better at learning to lie than individuals who show few psychopathic traits, according to a study published in the open access journal Translational Psychiatry. The ...

Higher cognitive abilities linked to greater risk of stereotyping

July 24, 2017
People with higher cognitive abilities are more likely to learn and apply social stereotypes, finds a new study. The results, stemming from a series of experiments, show that those with higher cognitive abilities also more ...

Exposure to violence hinders short-term memory, cognitive control

July 24, 2017
Being exposed to and actively remembering violent episodes—even those that happened up to a decade before—hinders short-term memory and cognitive control, according to a study published in the Proceedings of the National ...

Researchers pave new path toward preventing obesity

July 24, 2017
People who experience unpredictable childhoods due to issues such as divorce, crime or frequent moves face a higher risk of becoming obese as adults, according to a new study by a Florida State University researcher.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.