US cancer treatment guidelines 'often based on weak evidence'

March 7, 2018, British Medical Journal

Cancer treatment guidelines produced by the US National Comprehensive Cancer Network (NCCN) are often based on low quality evidence or no evidence at all, finds a study published by The BMJ today.

The researchers, led by Dr Vinay Prasad at Oregon Health & Science University, say their findings "raise concern that the NCCN justifies the coverage of costly, toxic drugs based on weak ."

NCCN guidelines are developed by a panel of cancer experts who make recommendations based on the best available evidence.

These recommendations are used by US private health insurers and social insurance schemes to make coverage decisions, and guide global cancer practice, but it is not clear how the evidence is gathered or reviewed.

In the US, the Food and Drug Administration (FDA) approves all new drugs and grants new indications for drugs already on the market. The NCCN makes recommendations both within and outside of FDA approvals, but patterns of NCCN recommendations beyond FDA approvals have not been analysed.

So Dr Prasad and his team compared FDA approvals of cancer drugs with NCCN recommendations in March 2016 for a contemporary sample of drugs. When the NCCN made recommendations beyond the FDA's approvals, the evidence used to support those recommendations was evaluated.

A total of 47 new cancer drugs were approved by the FDA for 69 indications over the study period, whereas the NCCN recommended these drugs for 113 indications, of which 69 (62%) overlapped with the 69 FDA approved indications and 44 (39%) were additional recommendations.

Only 10 (23%) of these additional recommendations were based on evidence from randomised controlled trials, and seven (16%) were based on evidence from phase III studies. Most relied on small, uncontrolled studies or case reports, or no offered evidence.

And almost two years after their analysis, the researchers found that only six (14%) of the additional recommendations by the NCCN had received FDA approval.

"The NCCN frequently makes additional recommendations for the use of drugs beyond approvals of the FDA and when it does so, it often fails to cite evidence or relies on low levels of evidence," write the authors.

"Few of these additional recommendations subsequently lead to approval," they add. "If there is additional evidence in support of these recommendations the NCCN should improve its process and cite all evidence used."

This is an observational study, so no firm conclusions can be drawn about cause and effect, and the researchers point to some limitations. However, they say, given that NCCN endorsement is linked to reimbursement by many commercial insurers and social insurance schemes, "our results suggest that payers may be covering with varying and scientifically less robust justification."

Finally, they point out that 86% of NCCN guidelines members have financial ties to the pharmaceutical industry, with 84% receiving personal payments and 47% receiving research payments.

"The presence of conflicted physicians has been shown to lead to more optimistic conclusions regarding disputed practices," they say. "Thus our findings raise concern about the nature of the recommendations offered by these individuals."

Explore further: Cancer care that knows no boundaries—NCCN guidelines customized for use in Africa

More information: Frequency and level of evidence used in recommendations by the National Comprehensive Cancer Network guidelines beyond approvals of the US Food and Drug Administration: retrospective observational study,

Related Stories

Cancer care that knows no boundaries—NCCN guidelines customized for use in Africa

November 13, 2017
The fact that you live in a particular country or community should not impact your ability to get good care for cancer.

NCCN publishes new guidelines for smoking cessation

March 13, 2015
Tobacco-related diseases are the most preventable cause of death worldwide; smoking cessation leads to improvement in cancer treatment outcomes, as well as decreased recurrence. According to the American Cancer Society, in ...

Novel chemotherapies more often used on- than off-label

February 26, 2013
(HealthDay)—In contemporary practice, medical oncologists use novel anticancer agents on-label more often than off-label, according to a study published online Feb. 19 in the Journal of Clinical Oncology.

Study finds links between physicians setting cancer care guidelines and drug industry

August 25, 2016
Nearly nine out of 10 physicians and researchers who helped develop a leading set of cancer care guidelines in the United States reported financial ties to the pharmaceutical and medical device industries, a University of ...

Mutations common in pancreatic CA, history of other cancers

February 7, 2018
(HealthDay)—A substantial proportion of individuals with pancreatic cancer and a history of other hereditary breast and ovarian cancer (HBOC)- or Lynch syndrome (LS)-related cancers have mutations in a prostate cancer susceptibility ...

New prostate cancer risk model could better guide treatment

March 7, 2018
One of the biggest challenges in treating prostate cancer is distinguishing men who have aggressive and potentially lethal disease from men whose cancer is slow-growing and unlikely to metastasize.

Recommended for you

Researchers create a drug to extend the lives of men with prostate cancer

March 16, 2018
Fifteen years ago, Michael Jung was already an eminent scientist when his wife asked him a question that would change his career, and extend the lives of many men with a particularly lethal form of prostate cancer.

Machine-learning algorithm used to identify specific types of brain tumors

March 15, 2018
An international team of researchers has used methylation fingerprinting data as input to a machine-learning algorithm to identify different types of brain tumors. In their paper published in the journal Nature, the team ...

Higher doses of radiation don't improve survival in prostate cancer

March 15, 2018
A new study shows that higher doses of radiation do not improve survival for many patients with prostate cancer, compared with the standard radiation treatment. The analysis, which included 104 radiation therapy oncology ...

Joint supplement speeds melanoma cell growth

March 15, 2018
Chondroitin sulfate, a dietary supplement taken to strengthen joints, can speed the growth of a type of melanoma, according to experiments conducted in cell culture and mouse models.

Improved capture of cancer cells in blood could help track disease

March 15, 2018
Tumor cells circulating throughout the body in blood vessels have long been feared as harbingers of metastasizing cancer - even though most free-floating cancer cells will not go on to establish a new tumor.

Area surrounding a tumor impacts how breast cancer cells grow

March 14, 2018
Cancer is typically thought of as a tumor that needs to be removed or an area that needs to be treated with radiation or chemotherapy. As a physicist and cancer researcher, Joe Gray, Ph.D., thinks differently.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.