Bias in the courtroom: Study finds impartial experts not so impartial

April 15, 2013 by Josh Barney, University of Virginia

(Medical Xpress)—Forensic psychologists and psychiatrists are ethically bound to be impartial, to look only at the evidence before them, when performing evaluations or providing expert opinions in court. But new research from the University of Virginia School of Medicine and Sam Houston State University suggests that the paycheck some courtroom experts receive influences their evaluations.

In a real-world experiment, experts who believed they were working for prosecutors tended to conclude that sexually violent offenders were at greater risk of re-offending than did experts who thought they were working for the defense, the researchers found.

"The findings were fairly alarming," U.Va. researcher Daniel Murrie said. "We suspected to find some of what we call the 'allegiance effect' – some difference between the sides – but the difference was more than we were expecting."

Murrie, director of psychology at U.Va.'s Institute of Law, Psychiatry and Public Policy and an associate professor of psychiatry and neurobehavioral sciences at the School of Medicine, has long been interested in the impartiality of forensic psychiatrists and psychologists. He both conducts forensic psychological evaluations and trains others to do so.

"For years I would have said, 'We really are unbiased, because we're required to be,'" he said. "But over the years I realized we really didn't have any genuine data on this important question, and that the field just took it on faith that evaluators could do their work objectively."

So he and his colleagues set out to find some hard numbers. After several in the field – where it is impossible to rule out other explanations for "adversarial allegiance" – they designed the most rigorous experiment they could.

The researchers recruited experienced forensic psychiatrists and psychologists from several states by offering a free continuing education workshop on the psychological tests used to evaluate sexually violent predators. A total of 118 attended, receiving real training over two days. In exchange, they agreed to provide paid consultation to a state agency that was reviewing a large number of sexually violent offender files. Or so they were told.

When the participants returned weeks later to provide paid consultation on what they thought was a large cohort of offender files, researchers actually gave all the participants the same four files to review. When participants met with a real lawyer, half were led to believe they were working with the defense, while the other half thought they were working with the prosecution.

The results were significantly different – and broke down along employment lines. The experts scored the offenders on two scales widely used in court proceedings. The experts who thought they were working for the prosecution tended to assign higher risk scores; the defense experts tended to assign lower risk scores.

The differences were striking because in other contexts, different experts usually provide very similar scores on these tests, and scores rarely differ by more than a few points. But in this study, the scores often differed more than the typical error rate, and they differed systematically depending on the side.

Not every expert demonstrated biased scoring, of course. But analyses suggested that most opposing pairs of evaluators had score differences greater than could be attributable to chance alone.

"It's disappointing, because we're not seeing clinicians demonstrate the objectivity we're all aspiring to," Murrie said of the study findings. "But it's also alarming because bias has such implications for justice. We really do want our justice system to have objective, reliable data, but at times the adversarial process that's supposed to bring us closer to the truth is actually distorting the truth."

Murrie mentioned that their findings were similar to recent evidence of bias in other forensic sciences, such as DNA and fingerprint analysis.

The findings are in press with the journal Psychological Science. Murrie hopes that the study will prompt in his field to take a hard look at how evaluators are trained and how they practice.

"Most people in this line of work really do try to be objective and pride themselves on being objective," Murrie said. "But our hope is that these results prompt us to better consider how these adversarial arrangements can affect our work, and to build some better safeguards."

Explore further: Brain scans appear to show changes associated with violent behavior

Related Stories

Brain scans appear to show changes associated with violent behavior

June 6, 2011
A brain imaging study suggests that men with a history of violent behavior may have greater gray matter volume in certain brain areas, whereas men with a history of substance use disorders may have reduced gray matter volume ...

Recommended for you

Intensive behavior therapy no better than conventional support in treating teenagers with antisocial behavior

January 19, 2018
Research led by UCL has found that intensive and costly multisystemic therapy is no better than conventional therapy in treating teenagers with moderate to severe antisocial behaviour.

Babies' babbling betters brains, language

January 18, 2018
Babies are adept at getting what they need - including an education. New research shows that babies organize mothers' verbal responses, which promotes more effective language instruction, and infant babbling is the key.

College branding makes beer more salient to underage students

January 18, 2018
In recent years, major beer companies have tried to capitalize on the salience of students' university affiliations, unveiling marketing campaigns and products—such as "fan cans," store displays, and billboard ads—that ...

Inherited IQ can increase in early childhood

January 18, 2018
When it comes to intelligence, environment and education matter – more than we think.

Modulating molecules: Study shows oxytocin helps the brain to modulate social signals

January 17, 2018
Between sights, sounds, smells and other senses, the brain is flooded with stimuli on a moment-to-moment basis. How can it sort through the flood of information to decide what is important and what can be relegated to the ...

Baby brains help infants figure it out before they try it out

January 17, 2018
Babies often amaze their parents when they seemingly learn new skills overnight—how to walk, for example. But their brains were probably prepping for those tasks long before their first steps occurred, according to researchers.


Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Apr 15, 2013
"The findings were fairly alarming," U.Va. researcher Daniel Murrie said. "We suspected to find some of what we call the 'allegiance effect' – some difference between the sides – but the difference was more than we were expecting."

"Experts" want to win, because it makes them look better. Therefore they will bias their testimony in favor of the side which favors their own advancement.

Just look at the Jodi Arias case. I've never seen so many excuses in my life as to why someone can be "innocent" of the crime of murder, even when it was so brutal, so deceptive, and so obviously premeditated. This idiotic trial is a perfect example of what is wrong with the modern courts in general, and what is wrong with human psychology today. Nobody is accountable for any crime. It's their ex-boyfriend's fault, or their parents' fault, or their school's fault, etc.

If anyone really believed that, why is there such a thing as "crime"? We'd just as well blame everything on the victims...
not rated yet Apr 15, 2013
I know this is off the topic but another area that should be looked at is the gullibility of jurors. As has been mentioned here those between about 22 and 55 are less likely to blindly believe what they are told because their brain's BS detector is fully developed and hasn't begun to deteriorate with age.

We had a local trial where a doctor, driving drunk, speeding, and texting went onto the shoulder, killed a girl, and drove home without stopping. His legal team got him off with the stunt of bringing the front end of his car into the courtroom to show the jury that he didn't stop because his big expensive car was so heavy that he didn't know he had hit anyone. The jury swallowed it and found him innocent of hit and run.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.