# Mathematical models out-perform doctors in predicting cancer patients' responses to treatment

##### April 20, 2013

Mathematical prediction models are better than doctors at predicting the outcomes and responses of lung cancer patients to treatment, according to new research presented today (Saturday) at the 2nd Forum of the European Society for Radiotherapy and Oncology (ESTRO).

These differences apply even after the doctor has seen the patient, which can provide extra information, and knows what the treatment plan and will be.

"The number of available for patients are increasing, as well as the amount of information available to the individual patient. It is evident that this will complicate the task of the doctor in the future," said the presenter, Dr Cary Oberije, a postdoctoral researcher at the MAASTRO Clinic, Maastricht University Medical Center, Maastricht, The Netherlands. "If models based on patient, and treatment characteristics already out-perform the , then it is unethical to make based solely on the doctors' opinions. We believe models should be implemented in clinical practice to guide decisions."

Dr Oberije and her colleagues in The Netherlands used mathematical that had already been tested and published. The models use information from previous patients to create a that can be used to predict the probability of outcome and responses to treatment using radiotherapy with or without for future patients.

Having obtained predictions from the mathematical models, the researchers asked experienced radiation oncologists to predict the likelihood of surviving for two years, or suffering from (dyspnea) and difficulty swallowing (dysphagia) at two points in time: 1) after they had seen the patient for the first time, and 2) after the treatment plan was made. At the first time point, the doctors predicted two-year survival for 121 patients, dyspnea for 139 and dysphagia for 146 patients. At the second time point, predictions were only available for 35, 39 and 41 patients respectively.

For all three predictions and at both time points, the mathematical models substantially outperformed the doctors' predictions, with the doctors' predictions being little better than those expected by chance.

The researchers plotted the results on a special graph on which the area below the plotted line is used for measuring the accuracy of predictions; 1 represents a perfect prediction, while 0.5 represents predictions that were right in 50% of cases, i.e. the same as chance. They found that the model predictions at the first time point were 0.71 for two-year survival, 0.76 for dyspnea and 0.72 for dysphagia. In contrast, the doctors' predictions were 0.56, 0.59 and 0.52 respectively.

The models had a better positive predictive value (PPV) – a measure of the proportion of patients who were correctly assessed as being at risk of dying within two years or suffering from dyspnea and dysphagia – than the doctors. The negative predictive value (NPV) – a measure of the proportion of patients that would not die within two years or suffer from dyspnea and dysphagia – was comparable between the models and the doctors.

"This indicates that the models were better at identifying high risk patients that have a very low chance of surviving or a very high chance of developing severe or ," said Dr Oberije.

The researchers say that it is important that further research is carried out into how prediction models can be integrated into standard clinical care. In addition, further improvement of the models by incorporating all the latest advances in areas such as genetics, imaging and other factors, is important. This will make it possible to tailor treatment to the individual patient's biological make-up and tumour type

"In our opinion, individualised treatment can only succeed if prediction models are used in clinical practice. We have shown that current models already outperform doctors. Therefore, this study can be used as a strong argument in favour of using prediction models and changing current clinical practice," said Dr Oberije.

"Correct prediction of outcomes is important for several reasons," she continued. "First, it offers the possibility to discuss treatment options with patients. If survival chances are very low, some patients might opt for a less aggressive treatment with fewer side-effects and better quality of life. Second, it could be used to assess which patients are eligible for a specific clinical trial. Third, correct predictions make it possible to improve and optimise the treatment. Currently, guidelines are applied to the whole lung cancer population, but we know that some patients are cured while others are not and some patients suffer from severe side-effects while others don't. We know that there are many factors that play a role in the prognosis of patients and prediction models can combine them all."

At present, prediction models are not used as widely as they could be by doctors. Dr Oberije says there are a number of reasons: some models lack clinical credibility; others have not yet been tested; the models need to be available and easy to use by doctors; and many doctors still think that seeing a patient gives them information that cannot be captured in a model. "Our study shows that it is very unlikely that a doctor can outperform a model," she concluded.

President of ESTRO, Professor Vincenzo Valentini, a radiation oncologist at the Policlinico Universitario A. Gemelli, Rome, Italy, commented: "The booming growth of biological, imaging and clinical information will challenge the decision capacity of every oncologist. The understanding of the knowledge management sciences is becoming a priority for in order for them to tailor their choices to cure and care for individual patients."

Explore further: Model against unnecessary use of antibiotics

More information: Abstract no: OC-0140, "Clinical 2 – Lung and Head & Neck cancer" session at 16.45 hrs (CEST) on Saturday 20 April, Auditorium.

## Related Stories

#### Model against unnecessary use of antibiotics

October 15, 2008

Patients in intensive care units are often administered antibiotics against ventilator-associated pneumonia, "to be on the safe side." Dutch researcher Stefan Visscher has developed a model that can quickly establish whether ...

#### Patients' pretreatment quality of life can predict overall lung cancer survival

September 2, 2009

Research published in the September 2009 issue of the Journal of Thoracic Oncology has found that an individual's quality of life prior to treatment can help predict the overall survival of patients with advanced stage non-small ...

#### New way to identify patients at risk of dysphagia after head and neck cancer treatment

February 25, 2011

At the 3rd International Conference on innovative approaches in Head and Neck Oncology (ICHNO), Dr Hanna Rahbek Mortensen and colleagues at hospitals and institutes in Denmark presented results from a large prospective trial, ...

#### Online prognostic tool for lung cancer developed

March 8, 2011

Determining the best way to treat lung cancer – the leading cancer killer for both men and women – is an ongoing challenge to cancer doctors. But researchers at the West Virginia University Mary Babb Randolph Cancer ...

#### New score can tell doctors how long cancer patients have left to live

August 26, 2011

A new scoring system can more reliably predict whether patients with advanced cancer are likely to survive for "days", "weeks" or "months" finds a study published in the British Medical Journal today.

#### Future medical conditions predicted with new statistical model

June 4, 2012

Analyzing medical records from thousands of patients, statisticians have devised a statistical model for predicting what other medical problems a patient might encounter.

## Recommended for you

#### Researchers find a new way to identify and target malignant aging in leukemia

August 26, 2016

Researchers at University of California San Diego School of Medicine and Moores Cancer Center have identified RNA-based biomarkers that distinguish between normal, aging hematopoietic stem cells and leukemia stem cells associated ...

#### Important advance made with new approach to 'control' cancer, not eliminate it

August 26, 2016

Researchers have created a new drug delivery system that could improve the effectiveness of an emerging concept in cancer treatment - to dramatically slow and control tumors on a long-term, sustained basis, not necessarily ...

#### Discovery of a novel Wnt inhibitor with potential to eradicate colorectal cancer stem cells

August 26, 2016

A team including the National Cancer Center (NCC), the RIKEN Center for Life Science Technologies (CLST), and Carna Biosciences Inc. has jointly announced the development of a novel small-molecule Wnt inhibitor named NCB-0846. ...

#### Breast cancer cells found to switch molecular characteristics

August 24, 2016

A study led by Massachusetts General Hospital (MGH) investigators reveals how spontaneous changes in the molecular characteristics of tumors can lead to tumors with a mixed population of cells requiring treatment with several ...

#### Scientists track metabolic pathways to find drug combination for pancreatic cancer

August 24, 2016

Cancer researchers have long observed the value of treating patients with combinations of anti-cancer drugs that work better than single drug treatments. Now, in a new study using laboratory-grown cells and mice, Johns Hopkins ...

#### Oxygen can impair cancer immunotherapy in mice

August 25, 2016

Researchers have identified a mechanism in mice by which anticancer immune responses are inhibited within the lungs, a common site of metastasis for many cancers. This mechanism involves oxygen inhibition of the anticancer ...