Skewed results? Failure to account for clinical trial drop-outs can lead to erroneous findings in top medical journals
(Medical Xpress) -- A new University at Buffalo study of publications in the world's top five general medical journals finds that when clinical trials do not account for participants who dropped out, results are biased and may even lead to incorrect conclusions.
Published recently in the British Medical Journal, the methodological study consisted of a systematic analysis of 235 clinical trials published in the world's top five general medical journals between 2005 and 2007 that claimed a statistically significant effect.
"We found that in up to a third of trials, the results that were reported as positive -- in other words, statistically significant -- would become negative -- not statistically significant, if the investigators had appropriately taken into consideration those participants who were lost to follow-up," says Elie A. Akl, MD, MPH, PhD, lead author, and associate professor of medicine, family medicine and social and preventive medicine at the University at Buffalo School of Medicine and Biomedical Sciences and School of Public Health and Health Professions. He also has an appointment at McMaster University.
"In other words, one of three claims of effectiveness of interventions made in top general medical journals might be wrong," he says.
In one example, a study that compared two surgical techniques for treating stress urinary incontinence found that one was superior. But in the analysis published this month, it was found that 21 percent of participants were lost to follow-up. "When we reanalyzed that study by taking into account those drop-outs, we found that the trial might have overestimated the superiority of one procedure over the other," Akl says.
According to Akl, it has always been suspected, but never proven, that loss to follow-up introduces bias into the results of clinical trials. "The methodology we developed allowed us to provide that proof," he says.
The methodology that he and his coauthors developed consists of sensitivity analyses, a statistical approach to test the robustness of the results of an analysis in the face of specific assumptions, in this case, assumptions about the outcomes of patients lost to follow-up.
"This study gives us a better understanding of the problem of loss to follow-up in clinical trials and provides us with better tools to address it," Akl says.
"This methodology will allow those who conduct the trials and those who use their results, including clinicians, other scientists, developers of clinical guidelines, policymakers and bodies like the Food and Drug Administration, to better judge the risk of bias," concludes Akl.
The studies that were analyzed had previously been published in Annals of Internal Medicine, British Medical Journal, the Journal of the American Medical Association, Lancet and the New England Journal of Medicine. To be included, the trials that were studied had to have reported a significant effect.
Akl led this major study, funded by Pfizer, which took three years to complete. His co-authors, 20 clinical epidemiologists, are from the following institutions: McMaster University; University Hospital Basel; Kaiser Permanente Northwest; Hospital for Sick Children in Toronto; Institute for Work and Health, UniversitÃ¨ de Sherbrooke; University Children's Hospital Tuebingen; Pontificia Universidad Catolica de Chile; Tel Aviv University; the University of Ottawa; the University of Freiburg and the University of Oxford.
Provided by University at Buffalo
- Behavior of people faced with health-care choices is not influenced by 'framing effect,' study finds Dec 07, 2011 | not rated yet | 0
- Should low molecular weight heparin be used in cancer treatment? Feb 15, 2012 | not rated yet | 0
- Drug trials funded by industry are more likely to publish favorable results Aug 02, 2010 | not rated yet | 0
- Half of trials supporting FDA applications go unpublished Sep 23, 2008 | not rated yet | 0
- Slime mold mimics Canadian highway network (w/ video) Mar 26, 2012 | not rated yet | 0
- Motion perception revisited: High Phi effect challenges established motion perception assumptions Apr 23, 2013 | 3 / 5 (2) | 2
- Anything you can do I can do better: Neuromolecular foundations of the superiority illusion (Update) Apr 02, 2013 | 4.5 / 5 (11) | 5
- The visual system as economist: Neural resource allocation in visual adaptation Mar 30, 2013 | 5 / 5 (2) | 9
- Separate lives: Neuronal and organismal lifespans decoupled Mar 27, 2013 | 4.9 / 5 (8) | 0
- Sizing things up: The evolutionary neurobiology of scale invariance Feb 28, 2013 | 4.8 / 5 (10) | 14
Classical and Quantum Mechanics via Lie algebras
Apr 15, 2011 I'd like to open a discussion thread for version 2 of the draft of my book ''Classical and Quantum Mechanics via Lie algebras'', available online at http://lanl.arxiv.org/abs/0810.1019 , and for the...
- More from Physics Forums - Independent Research
More news stories
Researchers from the National Institute of Advanced Industrial Science and Technology (AIST), and the Research Institute of Electrical Communication (RIEC) of Tohoku University have jointly developed an auditory ...
Other 24 minutes ago | not rated yet | 0
Vermont became on Monday the third US state to legalize physician-assisted suicide.
Other 15 hours ago | not rated yet | 0
Food microbiology laboratories continue to submit false negative results and false positive results on a routine basis. A retrospective study of nearly 40,000 proficiency test results over the past 14 years, presented today ...
Other 20 hours ago | not rated yet | 0
Siemens has presented the world's first ultrasound system with wireless transducers. The system's transducers, which can be easily operated with one hand, transmit ultrasound images via radio waves to the ...
Other May 20, 2013 | not rated yet | 0
In a remote fishing community in Venezuela, a lone fisherman sits on a cliff overlooking the southern Caribbean Sea. This man –– the lookout –– is responsible for directing his comrades on the water, ...
8 minutes ago | not rated yet | 0 |
A novel approach to obstructing the runaway inflammatory response implicated in some types of asthma has shown promise in a Phase IIa clinical trial, according to U. S. researchers.
2 minutes ago | not rated yet | 0
Authorities are investigating rice mills in southern China following tests that found almost half of the staple grain in one of the country's largest cities was contaminated with a toxic metal.
8 minutes ago | not rated yet | 0
Scientists from Nanyang Technological University (NTU) and Lund University, Sweden, have bioengineered a novel molecule which has been proven to successfully kill tumour cells.
17 minutes ago | not rated yet | 0
Regardless of pain, social class or age, a woman is more likely to be prescribed pain-relieving drugs. A study published in Gaceta Sanitaria (Spanish health scientific journal) affirms that this phenomenon is inf ...
27 minutes ago | not rated yet | 0