Study finds public reporting of death rates is unlikely to identify poorly performing surgeons

July 4, 2013

New research published in The Lancet suggests that the publication of death rates for individual surgeons in England, launched for the first of a new group of 10 specialties last week, is unlikely to correctly identify poorly performing surgeons in some specialties, because low numbers of key operations lead to unreliable results.

"Our study reveals that although may reflect the performance of individual for some procedures like cardiac surgeries which are performed more frequently, they may be far less effective for other procedures such as resection which is done less commonly", explains Dr Jenny Neuburger, one of the researchers from the London School of Hygiene & Tropical Medicine who carried out the research.

"The danger is that low numbers will mean that chance factors overwhelm the influence of surgeon performance on the number of deaths. This could mask poor performance and lead to false complacency."

Using national mortality data for adult cardiac surgery and key operations in three other specialties (bowel cancer resection, oesophagectomy or gastrectomy, and hip fracture surgery), the research team calculated how many procedures would be necessary for reliable detection of poor performance and how many surgeons in English NHS hospitals actually do that number of operations. They found that the numbers of operations needed for the statistical power necessary to detect truly poor performance exceed the annual number of procedures typically done by surgeons.

For example, they estimated that for bowel cancer surgeries, to achieve even 60% statistical power (meaning that of ten surgeons that were truly performing poorly, on average six would be identified) the annual median number of would need to be ten times higher than it currently is.

When looking at 3 years of data, about three-quarters of surgeons do sufficient numbers of hip fracture and cardiac operations every year to identify cases of poor performance. For bowel cancer resection and oesophagectomy or gastrectomy procedures the percentages were just 17% and 9% respectively, and rose to about a third of surgeons based on five years of data.

It was hoped that public disclosure of surgeon performance would provide transparency, help patients choose the best surgeons, and provide an incentive to improve the quality of care. But such reporting is only useful if it contains accurate information. According to Dr Neuburger, "The reporting of results for individual surgeons should be based on outcomes that are fairly frequent, and fortunately, from the point of view of patients, mortality is not one of them. For specialties in which most surgeons do not perform sufficient numbers of to reliably assess their outcomes, reporting should be at the level of the surgical team or hospital, and not the surgeon."

Explore further: Surgeon experience affects complication rate of spinal stenosis surgery

More information:

Related Stories

Surgeons reach radiation limits with 291 PELDs per year

April 12, 2013

(HealthDay)—Surgeons performing minimally invasive transforaminal percutaneous endoscopic lumbar discectomy (PELD), involving fluoroscopy, are exposed to the maximum allowable radiation dose after 291 procedures performed ...

Recommended for you

Outside the body, a heart beats via life-saving system

September 1, 2015

(Medical Xpress)—A system that enables heart transplants involving hearts that stopped beating in the donor's body continues to save lives. The Organ Care System (OCS) has been used in UK hospitals with good results.

A recipe for long-lasting livers

April 22, 2015

People waiting for organ transplants may soon have higher hopes of getting the help that they need in time. Researchers at the RIKEN Center for Developmental Biology have developed a new technique that extends the time that ...

Surgeon to offer ideas on a way to do human head transplants

February 26, 2015

Sergio Canavero of the Turin Advanced Neuromodulation Group has made it known that he intends to announce at this summer's American Academy of Neurological and Orthopedic Surgeons meeting, that he believes he has put together ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.