Hospital mortality rates unreliable, research finds

October 18, 2012

(Medical Xpress)—A brand new study by the University of Birmingham suggests that the system used by the Government to inform key decisions about the performance of NHS hospitals is inadequate.

Research published online today in the journal BMJ Quality and Safety shows that Standardised Mortality Ratios (SMRs) are not a reliable indicator of the quality of hospital care and therefore should not be used to trigger inquiries such as the high-profile probe being conducted into the performance of Mid Staffordshire Hospital.

A recent academic paper concluded that an observed lack of agreement between different methods for calculating hospital-wide may result from 'fundamental flaws in the hypothesised association between hospital-wide mortality and quality of care.' Such a flaw would arise if preventable deaths were low in relation to inevitable deaths.

The Birmingham team's paper models the correlation between overall risk-adjusted deaths and deaths due to poor care. The researchers developed a - which was vetted and verified by international referees - to estimate the proportionate variation in SMRs that can be accounted for by fluctuations in preventable deaths.

'The relationship between overall mortality and deaths preventable by better care is not linear,' explains Professor Richard Lilford, Professor of at Birmingham and lead author of the study. 'The signal () gets lost in the noise (inevitable deaths) unless more than a quarter of all deaths are preventable. 'The appalling idea that one in four of all NHS hospital deaths are preventable is not backed up by current evidence and does not make sense given that we all have to die and nearly half of us do so in hospital.'

'It may be an inconvenient truth but we are saying that even when you have obtained risk-adjusted figures, they are still not a good measure of quality unless a large proportion (over 25 per cent) of the overall deaths are preventable. Therefore, we should not study overall mortality rates, even as a survey tool, in situations where people are going to die anyway.' says Professor Lilford.

'The fallacy is to assume that by doing the risk-adjustment process you have solved the problem,' he adds. 'This model offers a reality check for case-mix adjustment schemes designed to isolate the preventable component of any outcome rate. We would advise caution about using overall rates of mortality even after risk adjustment. It is preferable to look directly at quality of care.'

Explore further: Women's mortality rates for cardiovascular disease differ widely among hospitals

More information: Case mix adjusted hospital mortality is a poor proxy for preventable mortality: a modelling study. BMJ Quality and Safety.

Related Stories

'Report cards' don't reflect preventable bypass deaths

June 9, 2008

While death rate "report cards" indicated low mortality rates after heart bypass surgery, a review of in-hospital deaths in heart bypass patients at Ontario, Canada hospitals found that one-third might have been prevented, ...

Treatment checklists may cut hospital deaths

April 2, 2010

Patient deaths at three London hospitals have been cut by almost 15% after introducing treatment checklists (known as care bundles), finds a study published in the British Medical Journal today.

Using death rates to judge hospital performance 'a bad idea'

April 21, 2010

Mortality rates are a poor measure of the quality of hospital care and should not be a trigger for public inquiries such as the investigation at the Mid Staffordshire hospital, argue experts in a paper published in the British ...

Recommended for you

'Business diet' a bad deal for the heart

August 19, 2016

(HealthDay)—The typical "social business diet"—heavy on red meats, sweet drinks, processed snacks and booze—takes a toll on the heart, a new study finds.

Concussion rates rising significantly in adolescents

August 18, 2016

The number of Americans diagnosed with concussions is growing, most significantly in adolescents, according to researchers at UC San Francisco. They recommend that adolescents be prioritized for ongoing work in concussion ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.