For a less biased study, try randomization
A new review of existing research confirms that the so-called gold standard of medical research the randomized controlled study provides a safeguard against bias.
The researchers found that certain kinds of studies those whose recruiters were more likely to know in which comparison group the next participant would land had larger estimates of effects than those that whose blinding was considered adequate. Yet the finding does not mean such studies are inaccurate.
The findings could give researchers more insight into the pros and cons of the strategies they embrace to figure out whether one drug or treatment is better than another. While it might seem obvious that a randomized study is the most reliable option, scientists do not universally believe it is, said review lead author Jan Odgaard-Jensen.
Although there is wide agreement about the value of randomized trials, some people still argue that randomized trials may not be more reliable than non-randomized studies, said Odgaard-Jensen, a statistician with the Norwegian Knowledge Center for the Health Service.
Even if researchers do acknowledge the superiority of randomized studies, many turn to a non-randomized approach that is cheaper and less complicated. For example, they could try to allocate patients in a study in a way that is not entirely random, such as assigning them to treatments based on ZIP code or gender, Odgaard-Jensen said.
So how much of a difference does randomization make in the results of a study? The review authors sought to find out by updating the results of a previous review.
The researchers deemed 18 papers all reviews or meta-analyses to fit their criteria to include in the review, which appears in the latest issue of The Cochrane Library.
The journal is a publication of The Cochrane Collaboration, an international organization that evaluates medical research. Systematic reviews draw evidence-based conclusions about medical practice after considering both the content and quality of existing medical trials on a topic.
The review authors found that randomized and non-randomized studies did not consistently yield a certain kind of result. Sometimes the estimates of effect a measurement of, say, whether a medication works were larger in randomized studies. However, they were larger in some non-randomized studies too.
The review authors write that, in general, it is not possible to figure out how biases in the kinds of studies could throw off the results. In other words, one cannot assume that a randomized controlled trial that yields a certain estimates of effect is more or less accurate than one that does not randomly assign participants, which yields a different estimate.
Dr. Gordon Guyatt, a professor of medicine at McMaster University, in Ontario, Canada, said the review findings confirm that we do not live in a simpler and more easy to handle world in which biases would always go in the same direction.
It turns out that the world is not a simple place, he said. Sometimes the bias goes in one direction and sometimes in another.
However, the unpredictability of randomization in a randomized study when its impossible to know beforehand whether a patient will end up in one group or another adds to the value of that specific approach, review lead author Odgaard-Jensen said. It is the best protection against the unpredictability of the extent and direction of bias in clinical trials that are not properly randomized.
Still, randomized trials are not guaranteed routes to the truth regarding a medical question, said Dr. Arthur Hartz, director of health service research at Huntsman Cancer Institute in Salt Lake City. I dont think any single study is conclusive. You often get randomized controlled trials that disagree with each other.
Randomized studies are often a nuisance too, he said. They take incredible amounts of time and money, and theyre boring, and by the time you get the results, medical technology has moved on.
One alternative is an observational study, in which researchers do not control which subjects get a particular medication or treatment, he said. (The new review did not examine the value of observational studies.)
We have some indications of where observational studies are giving bad results, but we dont understand exactly why they give bad results and how it could be fixed, Hartz said. Thats where the emphasis should be.
For his part, Guyatt said randomization is one of several safeguards against bias in studies, such as preventing various players from knowing who is getting which treatment and following up with as many subjects as possible to see what happened to them. If all these bias-reducing strategies are in place, randomized trials will always get you closer to the truth than studies that dont have all the safeguards, he said.
Ultimately, said Tufts University professor of medicine Dr. Joseph Lau, the new review has value to those developing tools to critically appraise studies in systematic reviews. It also has value to those proposing guidelines on improving the conduct and reporting of primary studies.
More information: Odgaard-Jensen J, et al. Randomisation to protect against selection bias in healthcare trials. Cochrane Database of Systematic Reviews 2011, Issue 4.
Provided by Health Behavior News Service
- Study finds pacifiers don't interfere with established breastfeeding Mar 16, 2011 | not rated yet | 0
- Mechanical versus manual CPR may be too close to call Jan 19, 2011 | not rated yet | 0
- Evidence of ginseng-boosted brain power is weak Dec 08, 2010 | not rated yet | 0
- Radiation helps cure Hodgkin’s lymphoma, but future cancer risk a concern Feb 16, 2011 | not rated yet | 0
- For back pain, spinal manipulation holds its own Feb 16, 2011 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
Classical and Quantum Mechanics via Lie algebras
Apr 15, 2011 I'd like to open a discussion thread for version 2 of the draft of my book ''Classical and Quantum Mechanics via Lie algebras'', available online at http://lanl.arxiv.org/abs/0810.1019 , and for the...
- More from Physics Forums - Independent Research
More news stories
People eating at fast food restaurants largely underestimate the calorie content of meals, especially large ones, according to a paper published today in BMJ.
Health 8 hours ago | not rated yet | 0
Don't doubt it when a woman harried by hot flashes says she's having a hard time remembering things. A new study published online in Menopause, the journal of The North American Menopause Society (NAMS), helps confirm with o ...
Health 9 hours ago | not rated yet | 0
The Senate has overwhelmingly rejected an amendment allowing states to require labeling of genetically modified foods.
Health 10 hours ago | not rated yet | 1
(AP)—McDonald's once again faced criticism that it's a purveyor of junk food that markets to children at its annual shareholder meeting Thursday.
Health 10 hours ago | not rated yet | 0
Can economic incentives such as gift cards, T-shirts, and time off from work motivate members of the public to increase their donations of blood?
Health 12 hours ago | not rated yet | 0 |
(Medical Xpress)—Regulating the distribution of power in neurons is done by a system that makes the national electric grid look simple by comparison. Each neuron has several thousand mitochondria confined ...
9 hours ago | 4.8 / 5 (5) | 0 |
A brief visual task can predict IQ, according to a new study. This surprisingly simple exercise measures the brain's unconscious ability to filter out visual movement. The study shows that individuals whose ...
14 hours ago | 4.4 / 5 (9) | 0 |
Teams of highly respected Alzheimer's researchers failed to replicate what appeared to be breakthrough results for the treatment of this brain disease when they were published last year in the journal Science.
12 hours ago | 5 / 5 (1) | 2 |
Scientists at the National Institutes of Health report they have discovered in mouse studies that a small molecule released in the spinal cord triggers a process that is later experienced in the brain as ...
12 hours ago | 5 / 5 (2) | 0 |
Little is known about why asthma develops, how it constricts the airway or why response to treatments varies between patients. Now, a team of researchers at Weill Cornell Medical College, Columbia University Medical Center ...
13 hours ago | not rated yet | 0 |
Ethnic background plays a surprisingly large role in how diabetes develops on a cellular level, according to two new studies led by researchers at the Stanford University School of Medicine.
10 hours ago | not rated yet | 0 |