A gender-biased metric guides funding decisions in psychology research

January 13, 2012 By Divya Menon in Psychology & Psychiatry

How do psychologists gauge scientific impact? One way is the so-called “journal impact factor,” or JIF, a ranking of a journal derived from the number of citations by other authors to all of the articles it has published in a given year. But JIF isn’t just a statistical abstraction. “JIFs are increasingly used to assess and predict the merits of academic work,” which leads to decisions about hiring, promotion, and the allocation of scarce resources to researchers, says University of Surrey psychologist Peter Hegarty.

Needless to say, such a consequential measure must be as fair as possible. But JIF isn’t, say Hegarty and Surrey colleague Zoe Walton in a new article in Perspectives on Psychological Science, a journal published by the Association for Psychological Science. “Using JIF underestimates the impact of women researchers relative to men and the social science area relative to the natural science areas of psychology,” says Hegarty. For these reasons, the authors recommend administrators employ JIF “with caution.”

Hegarty and Walton performed a statistical analysis to assess whether JIF is the only, or even the best, way to predict which articles in leading psychology journals will garner the most citations—a number they got using the PsycINFO database. They sampled one issue published from 1996 through 2005 in each of nine high-impact psychology journals, which together represent nine sub-disciplines of psychology—1,133 articles in all. Their analysis included the sex of the first author; the number of pages, authors, and references, and the density of tables and graphs in the articles.  They asked which of these factors predicted citations in the five years following publication?

Along with JIF’s underestimation of citations to articles published by women psychologists, Hegarty and Walton found that articles that are longer, have more authors, and cite more references are themselves more frequently cited in turn.

The authors think there’s a link between the statistical slighting of papers authored by women in psychology and of those papers published in the social science areas of psychology: Women are better represented in those sub-disciplines and therefore published more often in such journals as the Journal of Personality and Social Psychology and Developmental Psychology. Men authors, meanwhile, currently predominate in experimental psychology and appear, for example, in the Journal of Cognitive Neuroscience.

It’s one complexity of a discipline that “straddles the natural and social sciences and is also a field of practice and application,” as well as theory and observation, says Hegarty, suggesting that measures of impact within psychology must be sensitive enough to account for the field’s complexity.

“Especially when you are using citation counts as a proxy for merit,” he says, “it is important to clarify the definition of academic merit. You want to make sure that the measure is not driving the definition of merit rather than the other way around.”

Journal reference: Perspectives on Psychological Science search and more info website Journal of Personality and Social Psychology search and more info website Journal of Cognitive Neuroscience search and more info website

Provided by American Psychiatric Association

1 /5 (2 votes)  

Rank 1 /5 (2 votes)
Tags

Related Stories
Relevant PhysicsForums posts

More news stories

Ketamine shows significant therapeutic benefit in people with treatment-resistant depression

Patients with treatment-resistant major depression saw dramatic improvement in their illness after treatment with ketamine, an anesthetic, according to the largest ketamine clinical trial to-date led by researchers from the ...

Psychology & Psychiatry created May 19, 2013 | popularity 4.8 / 5 (5) | comments 1 | with audio podcast

US psychiatry gets makeover in new manual

The latest makeover to a massive psychiatric tome honored by some, reviled by others and even called the "Bible" of mental disorders is being released Saturday with a host of new changes.

Psychology & Psychiatry created May 18, 2013 | popularity not rated yet | comments 1

Study reviews readmissions in inpatient psychiatric facilities

(HealthDay)—Most Medicare beneficiaries treated in inpatient psychiatric facilities (IPFs) exhibit characteristics associated with hospital readmission, according to a report prepared for the National Association ...

Psychology & Psychiatry created May 17, 2013 | popularity not rated yet | comments 0

Skydiving is never plane sailing

Skydivers show the same level of physical stress before every jump whether a first-timer or experienced jumper, say Northumbria researchers.

Psychology & Psychiatry created May 17, 2013 | popularity not rated yet | comments 0 | with audio podcast

Kids, especially boys, perceive sadness of depressed parents

Children of depressed parents pick up on their parents' sadness—whether mom or dad realizes their mood or not.

Psychology & Psychiatry created May 17, 2013 | popularity 4.5 / 5 (2) | comments 1 | with audio podcast


New theory on genesis of osteoarthritis comes with successful therapy in mice

Scientists at Johns Hopkins have turned their view of osteoarthritis (OA) inside out. Literally. Instead of seeing the painful degenerative disease as a problem primarily of the cartilage that cushions joints, ...

Computational tool translates complex data into simplified 2-dimensional images

In their quest to learn more about the variability of cells between and within tissues, biomedical scientists have devised tools capable of simultaneously measuring dozens of characteristics of individual ...

Researchers identify a potential new risk for sleep apnea: Asthma

Researchers at the University of Wisconsin have identified a potential new risk factor for obstructive sleep apnea: asthma. Using data from the National Institutes of Health (Heart, Lung, and Blood Institute)-funded Wisconsin ...

Study finds that sleep apnea and Alzheimer's are linked

A new study looking at sleep-disordered breathing (SDB) and markers for Alzheimer's disease (AD) risk in cerebrospinal fluid (CSF) and neuroimaging adds to the growing body of research linking the two.

'Gap' for HIV vaccine efforts after latest setback

The hunt for an HIV vaccine has gobbled up $8 billion in the past decade, and the failure of the most recent efficacy trial has delivered yet another setback to 26 years of efforts.

Ginger compounds may be effective in treating asthma symptoms

Gourmands and foodies everywhere have long recognized ginger as a great way to add a little peppery zing to both sweet and savory dishes; now, a study from researchers at Columbia University shows purified components of the ...