Study finds outcome data in clinical trials reported inadequately, inconsistently

May 14, 2014

There is increasing public pressure to report the results of all clinical trials to eliminate publication bias and improve public access. However, investigators using the World Health Organization's International Clinical Trials Registry Platform (ICTRP) to build a database of clinical trials involving chronic pain have encountered several challenges. They describe the perils and pitfalls of using the ICTRP and propose alternative strategies to improve clinical trials reporting. This important and insightful study is published in the August issue of the journal Pain.

U.S. law already requires posting summarized results on ClinicalTrials.gov, a service of the National Institutes of Health, within one year of study completion for certain categories of industry-sponsored trials. Legislation mandating data publication within one year of study completion, irrespective of outcome, is under consideration in the European Union. Yet compliance with the U.S. law is poor.

"Although clinical trial registries facilitate public access to basic trial information, we found that access to unbiased trial results is still inadequate. A distressingly large number of trials have no published results at all or are mentioned only in sponsor press releases. Recent analyses have found that only 25-35% of required to post study results on ClinicalTrials.gov actually do so," comments senior investigator Michael C. Rowbotham, MD, scientific director of the California Pacific Medical Center Research Institute in San Francisco.

The investigators drew on their experience with the Repository of Registered Analgesic Clinical Trials (RReACT) database, a scorecard for analgesic clinical trials for (sponsored by an FDA grant to the University of Rochester), to describe the challenge of constructing a global open-access database of clinical trials and trial results. They focused on three frequently studied chronic pain disorders: post-herpetic neuralgia, fibromyalgia, and painful diabetic peripheral neuropathy. The initial build of RReACT was limited to randomized trials registered on ClinicalTrials.gov with a primary (or key secondary) outcome measure assessing analgesic drug efficacy. The database was then expanded to report on all of the primary registries in the ICTRP, and investigators analyzed trial registration, registry functionality, and cross-registry harmonization, using a comprehensive search algorithm to find trial results in the peer-reviewed literature and grey literature. A total of 447 unique trials were identified, with 86 trials listed on more than one registry.

The ICTRP provides a single search portal to 15 primary registries, including ClinicalTrials.gov. ICTRP primary registries follow International Committee of Medical Journal Editors (ICMJE) guidelines and must have a national or regional focus, government support, nonprofit management, free , and an unambiguous trial identification method.

ClinicalTrials.gov is the largest ICTRP database, with more than 152,000 trials globally. The EU Clinical Trials Register (EU-CTR) is the second largest, with more than 21,000 trials. Current Controlled Trials (more than 11,000 trials), the oldest global registry, is hosted by BioMed Central (part of Springer Science + Business Media, a for-profit scientific publisher specializing in open-access journals). Five national registries each contain fewer than 1,000 trials. All ICTRP registries provide information about study design (i.e., randomization, blinding, control groups, inclusion/exclusion criteria, and outcome measures) and current study status. Not all ICTRP registries track study changes, list additional study identifiers, or provide links to publications.

"We identified several perils and pitfalls of using the ICTRP," says Dr. Rowbotham. "Manual searches are necessary, as ICTRP does not reliably identify trials listed on multiple registries. Searching ICTRP as a whole yields different results from searching registries individually. Outcome measure descriptions for multiply-registered vary between registries. Registry-publication pairings are often inaccurate or incomplete. Ideally, a PubMed search on the trial registration number would reveal all study-related articles, but a recent analysis showed that about 40% of journal publications failed to include registration numbers. And grey literature results—such as trial-specific press releases or company statements, information found on the websites of pharmaceutical companies, and abstracts of poster/platform presentations at scientific meetings—are not permanent.

"Creating a single global registry would solve many of the problems we describe here," he continues. "However, international politics and funding limitations suggest this is a challenging goal. Despite its flaws, ICTRP does at least offer a single search portal."

The investigators offer several suggestions for improving the current situation. In addition to the simple remedy of including trial registration numbers on all meeting abstracts and peer-reviewed papers, they propose specific strategies to identify multiply-registered studies and ensuring accurate pairing of results and publications.

"Compliance might improve, especially for difficult-to-publish 'negative' studies, if posting results on trial registries could be made simpler and uniform. Alternative solutions to the problems of and selective reporting should also be explored. These might involve including journals specializing in publishing 'negative' results, creating user-friendly and publicly available databases to publish results, and raising the awareness of authors, reviewers, and editors about these issues," concludes Dr. Rowbotham.

Explore further: Half of trial results in ClinicalTrials.gov not published

More information: "RReACT Goes Global: Perils and Pitfalls of Constructing a Global Open-Access Database of Registered Analgesic Clinical Trials and Trial Results," by Troels Munch; Faustine L. Dufka; Kaitlin Greene; Shannon M. Smith; Robert H. Dworkin; Michael C. Rowbotham (DOI: dx.doi.org/10.1016/j.pain.2014.04.007). It appears online ahead of Pain, Volume 155, Issue 8 (August 2014)

Related Stories

Half of trial results in ClinicalTrials.gov not published

December 3, 2013
Half of trials with results posted in ClinicalTrials.gov database have not been published in a journal, and for some that have, the database contains more information.

Discrepancies between trial results reported on clinical trial registry and in journals

March 11, 2014
During a one year period, among clinical trials published in high-impact journals that reported results on a public clinical trial registry (ClinicalTrials.gov), nearly all had at least 1 discrepancy in the study group, intervention, ...

Clinical trial results inconsistently reported among journals, government website

April 1, 2014
Medical researchers often presented the findings of their clinical trials in a different way on a federal government website than they did in the medical journals where their studies were ultimately published, according to ...

Results from many large clinical trials are never published

October 29, 2013
A new analysis of 585 large, randomized clinical trials registered with ClinicalTrials.gov finds that 29 percent have not been published in scientific journals. In addition, nearly 78 percent of the unpublished trials had ...

Clinical trial results for cancer drugs often not published

July 23, 2013
(HealthDay)—Although the U.S. Food and Drug Administration Amendments Act requires publication of the results of completed trials of cancer drugs conducted in the United States, results for almost half of the studies have ...

Many NIH-funded clinical trials go unpublished over two years after completion

January 4, 2012
In a study that investigates the challenges of disseminating clinical research findings in peer-reviewed biomedical journals, Yale School of Medicine researchers have found that fewer than half of a sample of trials primarily ...

Recommended for you

Drug therapy from lethal bacteria could reduce kidney transplant rejection

August 3, 2017
An experimental treatment derived from a potentially deadly microorganism may provide lifesaving help for kidney transplant patients, according to an international study led by investigators at Cedars-Sinai.

Exploring the potential of human echolocation

June 25, 2017
People who are visually impaired will often use a cane to feel out their surroundings. With training and practice, people can learn to use the pitch, loudness and timbre of echoes from the cane or other sounds to navigate ...

Team eradicates hepatitis C in 10 patients following lifesaving transplants from infected donors

April 30, 2017
Ten patients at Penn Medicine have been cured of the Hepatitis C virus (HCV) following lifesaving kidney transplants from deceased donors who were infected with the disease. The findings point to new strategies for increasing ...

'bench to bedside to bench': Scientists call for closer basic-clinical collaborations

March 24, 2017
In the era of genome sequencing, it's time to update the old "bench-to-bedside" shorthand for how basic research discoveries inform clinical practice, researchers from The Jackson Laboratory (JAX), National Human Genome Research ...

The ethics of tracking athletes' biometric data

January 18, 2017
(Medical Xpress)—Whether it is a FitBit or a heart rate monitor, biometric technologies have become household devices. Professional sports leagues use some of the most technologically advanced biodata tracking systems to ...

Financial ties between researchers and drug industry linked to positive trial results

January 18, 2017
Financial ties between researchers and companies that make the drugs they are studying are independently associated with positive trial results, suggesting bias in the evidence base, concludes a study published by The BMJ ...

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

Sinister1812
not rated yet May 14, 2014
The reason is because it's only ever about money. It's big business that puts profits before human health.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.