Questionable research practices surprisingly common
(Medical Xpress) -- Not all scientific misconduct is flat-out fraud. Much falls into the murkier realm of questionable research practices. A new study finds that in one field, psychology, these practices are surprisingly common. The survey of more than 2,000 research psychologists, published in Psychological Science, a journal of the Association for Psychological Science, finds that most have engaged in at least one of the questionable practices at some point in their career.
There have been some very widely publicized cases of outright fraud, says Leslie K. John of Harvard Business School. For example, a South Korean researcher achieved world-wide fame for cloning human stem cellsand infamy later when it turned out he had faked his data. Thats very clear-cut. Its an academic felony. But the focus of this paper isnt on these clear-cut cases; its about the more subtle ways of manipulating the truth. Along with her coauthors, George Loewenstein and Drazen Prelec, John designed a survey that was e-mailed to 5,964 psychological scientists. 2,155 responded. The researchers asked the questions using a method that attempts to make people more honest, in part by giving them an incentive to tell the truth.
They found that a surprising number of people had engaged in questionable research practices. For example, half the scientists admitted to having only reported the experiments that gave the results you wanted. This may not sound dramatic, and its not as bad as making up data, but it gives a skewed sense of the research; if scientists only report the results that support their hypotheses, they may leave out an important part of the picture. Other questionable practices include deciding whether to exclude data from a study after looking to see whether doing so affects the results (43.4 percent of respondents) and reporting an unexpected finding as if it had been expected all along (35 percent). And 1.7 percent of scientists admitted to having faked their data.
Its impossible to tell from the study how often these things happened; they could be part of the day-to-day practice of science or people could be admitting to something they did once in college. I think these are very high rates, but we dont know whether this is peoples standard operating procedure or whether theyre one-off activities, John says.
Does this mean we cant trust psychologists? No. No, this does not say that, John says. But there are clearly some problems. One possibility might be for psychological scientists to consider instituting a system like that starting to be used in medical research, in which journals will only accept articles for publication if the study was registered before it began, with details about how it would be executed. I think psychologists are motivated to do good science, John says. But these findings are disconcerting and signal the need for reform.
Journal reference: Psychological Science
Provided by Association for Psychological Science
- Is there a hidden bias against creativity? Nov 18, 2011 | not rated yet | 0
- Sexism and gender inequality Oct 28, 2011 | not rated yet | 0
- Being ignored hurts, even by a stranger Jan 25, 2012 | not rated yet | 0
- Are we bad at forecasting our emotions? It depends on how you measure accuracy Jan 26, 2012 | not rated yet | 0
- Deliberate practice: necessary but not sufficient Oct 24, 2011 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
How can there be a term called "intestinal metaplasia" of stomach
8 hours ago Hello everyone, Ok Stomach's normal epithelium is simple columnar, now in intestinal type of adenocarcinoma of stomach it undergoes "intestinal...
Pressure-volume curve: Elastic Recoil Pressure don't make sense
May 18, 2013 From pressure-volume curve of the lung and chest wall (attached photo), I don't understand why would the elastic recoil pressure of the lung is...
If you became brain-dead, would you want them to pull the plug?
May 17, 2013 I'd want the rest of me to stay alive. Sure it's a lousy way to live but it beats being all-the-way dead. Maybe if I make it 20 years they'll...
MRI bill question
May 15, 2013 Dear PFers, The hospital gave us a $12k bill for one MRI (head with contrast). The people I talked to at the hospital tell me that they do not...
Ratio of Hydrogen of Oxygen in Dessicated Animal Protein
May 13, 2013 As an experiment, for the past few months I've been consuming at least one portion of Jell-O or unflavored Knox gelatin per day. I'm 64, in very...
Alcohol and acetaminophen
May 13, 2013 Edit: sorry for the typo in the title , can't edit I looked around on google quite a bit and it's very hard to find precise information on the...
- More from Physics Forums - Medical Sciences
More news stories
Youth who had a schoolmate die by suicide are significantly more likely to consider or attempt suicide, according to a study in published in CMAJ (Canadian Medical Association Journal). This effect can last 2 years or mo ...
Psychology & Psychiatry 2 hours ago | not rated yet | 0
Johns Hopkins researchers say they have discovered specific chemical alterations in two genes that, when present during pregnancy, reliably predict whether a woman will develop postpartum depression.
Psychology & Psychiatry 10 hours ago | not rated yet | 0 |
A Mediterranean diet with added extra virgin olive oil or mixed nuts seems to improve the brain power of older people better than advising them to follow a low-fat diet, indicates research published online in the Journal of ...
Psychology & Psychiatry 20 hours ago | 3.5 / 5 (2) | 2
More people are being diagnosed with eating disorders every year and the most common type is not either of the two most well known—bulimia or anorexia—but eating disorders not otherwise specified (eating disorders that ...
Psychology & Psychiatry 20 hours ago | not rated yet | 0
Turns out, that old "practice makes perfect" adage may be overblown. New research led by Michigan State University's Zach Hambrick finds that a copious amount of practice is not enough to explain why people ...
Psychology & Psychiatry 21 hours ago | 3.3 / 5 (12) | 0 |
Researchers at USC have found that a class of pharmaceuticals can both prevent and treat Alzheimer's Disease in mice.
39 minutes ago | not rated yet | 0 |
The decision to limit life support in patients in the intensive care unit (ICU) appears to be significantly influenced by physician practices and/or the culture of the hospital, suggests new findings from researchers at the ...
57 minutes ago | not rated yet | 0
Children with obstructive sleep apnea who had a common surgery to remove their tonsils and adenoids showed notable improvements in behavior, quality of life and other symptoms compared to those treated with "watchful waiting" ...
57 minutes ago | not rated yet | 0
(Medical Xpress)—Native peoples in regions where cameras are uncommon sometimes react with caution when their picture is taken. The fear that something must have been stolen from them to create the photo ...
3 hours ago | 4 / 5 (3) | 0 |
(Medical Xpress)—Despite spending billions of dollars on research and development, drug companies have been unable to come up with effective treatments for dementia and Alzheimer's Disease (AD). Now, A. ...
1 hour ago | 4.7 / 5 (3) | 0 |
Australian scientists have charted the path of insulin action in cells in precise detail like never before. This provides a comprehensive blueprint for understanding what goes wrong in diabetes.
3 hours ago | 4.5 / 5 (2) | 0 |