How should systematic reviews consider evidence on harms?

Systematic reviews that attempt to assess the risk of harms (adverse effects) associated with specific therapies should consider a broad range of study designs, including both systematic reviews and observational studies. These are the findings of a new study, led by Su Golder of the Centre for Reviews and Dissemination, University of York, UK published in this week's PLoS Medicine.

There is increasing focus on the importance of using rigorous methods to assess the effectiveness and harms associated with the use of and other therapies, and recognition of the role of systematic reviews in this process. A uses predefined, explicit methods to find and appraise all relevant evidence to answer a specific question in healthcare. However, there has been considerable debate as to whether systematic reviews should use evidence from randomized controlled trials or observational studies (or both) in order to collect all the relevant evidence on risk of harms. Some groups have argued that observational studies may produce biased estimates of harm, while randomized trials may be too small to generate useful data on the risk of rare adverse effects.

In the study, Golder and colleagues identified systematic reviews that had compared the risk of specific harms in evidence from versus the evidence from observational studies. They found that there was no difference on average in the estimates produced by these two approaches. The authors conclude: "Instead of restricting the analysis to certain study designs, it may be preferable for systematic reviewers of to evaluate a broad range of studies that can help build a complete picture of any potential harm and improve the generalisability of the review without loss of validity."

Explore further

Acupuncture for pain no better than placebo and not without harm

More information: Golder S, Loke YK, Bland M (2011) Meta-analyses of Adverse Effects Data Derived from Randomised Controlled Trials as Compared to Observational Studies: Methodological Overview. PLoS Med 8(5): e1001026. doi:10.1371/journal.pmed.1001026
Citation: How should systematic reviews consider evidence on harms? (2011, May 3) retrieved 15 September 2019 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Feedback to editors

User comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more