What are IQ tests really measuring?

April 26, 2011 by Deborah Braconnier report

(Medical Xpress) -- When the average person thinks of an IQ test, they think of a measurement of intelligence. A test designed to find those of high intelligence who will go on to succeed in academics and employment. While the question has long been debated by researchers as to what exactly the IQ test measures, a new study shows that intelligence may not be the main focus, but a person’s motivation as well.

Published in the , psychologist Angela Lee Duckworth from the University of Pennsylvania reports her findings on how motivation levels seem to affect IQ results.

The report looks at two studies performed by Duckworth and her team. In the first study they combined the results from 46 previous studies where monetary incentives were used in IQ testing for meta-analysis. This combination brought together more than 2000 subjects. The ranges of monetary incentives were from $1 to $10 or more. Researchers used a statistical parameter called Hedge’s g to indicate the effects (g values 20 IQ points). On the opposite side of the spectrum, those receiving less than $1 incentive were only 0.1 effective.

In the second study they examined a previous study of 500 boys in Pittsburgh, Pennsylvania who were given IQ tests in the late 80s. The average age of the boys was 12.5 years old. During the IQ test, they had been videotaped and those trained to detect signs of boredom had evaluated the tapes and assessed each boy a motivational score.

By creating a series of computer models of the data, the team discovered that those with a higher motivational score achieved a higher IQ score and the prediction of later success in life held true. These differences in motivational score accounted for up to 84% of the difference in years of school they completed, however only 25% of the differences relating to how well they had done in school during their teenage years.

Researchers believe that while the is measuring raw , it is also measuring motivation and how much subjects want to succeed, both on the test and in life.

• Follow Medical Xpress on Facebook!
• Follow Medical Xpress on Twitter!

More information: Role of test motivation in intelligence testing, PNAS, Published online before print April 25, 2011, doi: 10.1073/pnas.1018601108

Intelligence tests are widely assumed to measure maximal intellectual performance, and predictive associations between intelligence quotient (IQ) scores and later-life outcomes are typically interpreted as unbiased estimates of the effect of intellectual ability on academic, professional, and social life outcomes. The current investigation critically examines these assumptions and finds evidence against both. First, we examined whether motivation is less than maximal on intelligence tests administered in the context of low-stakes research situations. Specifically, we completed a meta-analysis of random-assignment experiments testing the effects of material incentives on intelligence-test performance on a collective 2,008 participants. Incentives increased IQ scores by an average of 0.64 SD, with larger effects for individuals with lower baseline IQ scores. Second, we tested whether individual differences in motivation during IQ testing can spuriously inflate the predictive validity of intelligence for life outcomes. Trained observers rated test motivation among 251 adolescent boys completing intelligence tests using a 15-min “thin-slice” video sample. IQ score predicted life outcomes, including academic performance in adolescence and criminal convictions, employment, and years of education in early adulthood. After adjusting for the influence of test motivation, however, the predictive validity of intelligence for life outcomes was significantly diminished, particularly for nonacademic outcomes. Collectively, our findings suggest that, under low-stakes research conditions, some individuals try harder than others, and, in this context, test motivation can act as a third-variable confound that inflates estimates of the predictive validity of intelligence for life outcomes.

Related Stories

Recommended for you

Babies can learn that hard work pays off

September 21, 2017
If at first you don't succeed, try, try again. A new study from MIT reveals that babies as young as 15 months can learn to follow this advice. The researchers found that babies who watched an adult struggle at two different ...

Study links brain inflammation to suicidal thinking in depression

September 21, 2017
Patients with major depressive disorder (MDD) have increased brain levels of a marker of microglial activation, a sign of inflammation, according to a new study in Biological Psychiatry by researchers at the University of ...

Oxytocin turns up the volume of your social environment

September 20, 2017
Before you shop for the "cuddle" hormone oxytocin to relieve stress and enhance your social life, read this: a new study from the University of California, Davis, suggests that sometimes, blocking the action of oxytocin in ...

Researchers develop new tool to assess individual's level of wisdom

September 20, 2017
Researchers at University of San Diego School of Medicine have developed a new tool called the San Diego Wisdom Scale (SD-WISE) to assess an individual's level of wisdom, based upon a conceptualization of wisdom as a trait ...

Alcohol use affects levels of cholesterol regulator through epigenetics

September 20, 2017
In an analysis of the epigenomes of people and mice, researchers at Johns Hopkins Medicine and the National Institutes of Health report that drinking alcohol may induce changes to a cholesterol-regulating gene.

Self-control may not diminish throughout the day

September 20, 2017
After a long day of work and carefully watching what you eat, you might expect your self-control to slip a little by kicking back and cracking open a bag of potato chips.


Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Apr 26, 2011
"those trained to detect signs of boredom"

Sounds like an exciting field. haha
3 / 5 (2) Apr 26, 2011
I knew George W wasn't stupid, he was just bored! bwahahahaha
not rated yet Apr 26, 2011
They test the persons ability in sitting IQ tests.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.