No evidence of 'gaming' after death rates for bowel surgeons published

May 2, 2018, British Medical Journal

There is no evidence that publishing patient death rates for individual bowel surgeons in England has led to risk averse behaviour or 'gaming' of data, finds a study published by The BMJ today.

In fact, the results show that the introduction of public reporting of individual surgeons' outcomes coincided with a substantial reduction in for having non-emergency ("elective" or "scheduled") bowel .

Similar improvements were not found for emergency surgery, suggesting that improvements in care before, during and after major bowel surgery—only possible for elective procedures—may explain the findings.

When patient death rates for individual surgeons were first published in June 2013, the move was hailed as a major breakthrough in transparency that would drive up standards of care in England.

But critics argue that public reporting of outcomes encourages risk averse behaviour, whereby surgeons are less likely to offer surgery to patients at higher risk, and manipulation of data to increase patients' predicted risk or to make patients ineligible for public reporting, often referred to as "gaming."

So far, the evidence that public reporting leads to improvements in the quality of patient care is surprisingly weak, and its effect has been studied only in cardiac surgery and almost exclusively in the US.

So a team of UK researchers led by Kate Walker from the London School of Hygiene & Tropical Medicine, decided to look for evidence of risk averse behaviour, manipulation of data, and change in death rates immediately before and after the introduction of surgeon specific outcome reporting in surgery across the NHS in England.

They analysed data for over 111,000 patients included in the National Bowel Cancer Audit (NBOCA) diagnosed with colorectal cancer from April 2011 to March 2015.

To investigate risk averse behaviour, they compared the proportion of patients who had elective surgery, predicted 90 day mortality, and observed 90 day mortality, before and after the introduction of public outcome reporting.

After factors that could have affected the results, such as patient characteristics and tumour grade, were taken into account, the researchers found that the proportion of patients with colorectal cancer who had major surgery did not change after the introduction of public outcome reporting (63.3% before compared with 63.2% after).

The proportion of urgent or emergency procedures—and therefore ineligible for public reporting—also did not change after the introduction of public reporting (15.5% before compared with 15.6% after).

The predicted 90 day mortality remained the same (2.7%), but the observed 90 day mortality fell from 2.8% before to 2.1% after. Further analysis showed that this reduction was over and above the existing downward trend in mortality before the introduction of public reporting.

The authors outline some strengths of the study, noting the large sample size which represents 92% of all colorectal cancer patients admitted to an English NHS hospital. However, they point out that this is an observational study, so no firm conclusions can be drawn about cause and effect—and say that using a "before-after" design is a potential weakness as changes may occur in the quality of data over time.

Nevertheless, they say their study "provides unique evidence that the introduction of public reporting of outcomes for individual colorectal cancer surgeons has not led to a decrease in the number of patients at high risk undergoing a major resection and has coincided with an improvement in 90 day mortality for eligible patients."

These findings suggest that public reporting for individual clinicians "seems to have triggered an improvement in outcomes after elective procedures that can be achieved only through the involvement of the entire clinical team," they conclude.

Explore further: Emergency treatment by older surgeons linked to slightly lower death rates

More information: Effect of public reporting of surgeons' outcomes on patient selection, "gaming," and mortality in colorectal cancer surgery in England: population based cohort study, The BMJ,

Related Stories

Emergency treatment by older surgeons linked to slightly lower death rates

April 26, 2018
Patients undergoing emergency surgery who are treated by older surgeons (aged 60 or over) have slightly lower death rates in the first few weeks after their operation than patients treated by younger surgeons (aged less than ...

Mandatory public reporting of coronary artery bypass grafting associated with better patient outcomes

April 30, 2018
Mandatory public reporting of coronary artery bypass grafting (CABG) results in Massachusetts was associated with better patient outcomes compared to national findings, according to a recent study. Results of the 13-year ...

Study finds public reporting of death rates is unlikely to identify poorly performing surgeons

July 4, 2013
New research published in The Lancet suggests that the publication of death rates for individual surgeons in England, launched for the first of a new group of 10 specialties last week, is unlikely to correctly identify poorly ...

Public reporting of hospital mortality rates for common conditions did not improve patient outcomes

May 30, 2016
Public reporting of hospital mortality rates to the Hospital Compare Program was not associated with an improvement in 30-day mortality rates. The findings are published in Annals of Internal Medicine.

Age is not a risk factor for complications after surgery among older patients

January 12, 2018
Among older patients, frailty and cognitive impairment before surgery are associated with developing complications after surgery, but age is not, a new study suggests.

Surgery practice patterns differ by location of residency

January 12, 2018
(HealthDay)—Nonuniversity-based residency (NUBR)-trained surgeons and university-based residency (UBR)-trained surgeons have distinct practice patterns, according to a study published online Jan. 10 in JAMA Surgery.

Recommended for you

Amount of weight regain after bariatric surgery helps predict health risks

October 16, 2018
Measuring the percentage of weight regained following the maximum amount of weight lost after bariatric surgery can help predict a patient's risk of several serious health problems, according to a long-term, multicenter study ...

Technique to 'listen' to a patient's brain during tumour surgery

October 16, 2018
Surgeons could soon eavesdrop on a patient's brain activity during surgery to remove their brain tumour, helping improve the accuracy of the operation and reduce the risk of impairing brain function.

Researchers link gut bacteria to heart transplant success or failure

October 4, 2018
In a new study, researchers at the University of Maryland School of Medicine (UMSOM) have found that the gut microbiome appears to play a key role in how well the body accepts a transplanted heart. The scientists found a ...

Focus on neuroscience, nociception to improve anesthesia, paper says

October 1, 2018
People sometimes mistakenly think of general anesthesia as just a really deep sleep but in fact, anesthesia is really four brain states—unconsciousness, amnesia, immobility and suppression of the body's damage sensing response, ...

Bariatric surgery linked to safer childbirth for the mother

September 27, 2018
Obese mothers who lose weight through bariatric surgery can have safer deliveries. The positive effects are many, including fewer caesarean sections, infections, tears and haemorrhages, and fewer cases of post-term delivery ...

Antibiotics for appendicitis? Surgery often not needed

September 25, 2018
When emergency tests showed the telltale right-sided pain in Heather VanDusen's abdomen was appendicitis, she figured she'd be quickly wheeled into surgery. But doctors offered her the option of antibiotics instead.


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.