Infection data may not be comparable across hospitals, study shows

September 18, 2012

A new study has found that some kinds of infection data may not be comparable across hospitals, and may not be suitable for use as a performance measure.

Published in the leading US policy journal Milbank Quarterly, the research found huge variability in how English hospitals collected, recorded and reported their rates of central line infections to a patient safety programme. The study was funded by the Health Foundation, a major UK charitable foundation aiming to improve quality of care.

"Central line infections occur in tubes used in treating seriously ill patients. These infections are largely preventable, and hospitals need to be able to monitor how well they are doing in controlling them," said study author Professor Mary Dixon-Woods from University of Leicester. "But because hospitals don't use the same methods to generate the data, using their reported rates to produce league tables of performance or to impose financial sanctions, as happens in the US, is probably not appropriate."

Researchers found most variability arose for what they called "mundane" reasons. These included challenges in setting up data collection systems, different practices in sending for analysis, and difficulties in deciding the source of infections.

"Although hospitals were given clear, standardised definitions to use, many laboratories did not have the tools to make the most definitive assessment of where infections were coming from in the patient's body," said Julian Bion, Professor of at University of Birmingham. "That meant they had to use to decide whether any infection was due to a central line. Once you are relying on judgement, you will get variation."

The study dismissed 'gaming' as the explanation for the variations the researchers found. "Some previous studies have reported deliberate manipulation of performance data to 'look good'", said Professor Dixon-Woods. "We found very little evidence of this. We did find that doctors were fine with making a clinical decision that a patient might have a central line infection for purposes of treating them, but they wanted better evidence if they were going to report an infection externally. That meant that sometimes a patient who was treated as having an infection while in was not counted as having an when data were reported. Doctors also varied in how many blood samples they sent off for laboratory analysis".

Professor Bion commented that these findings have important lessons for those involved in improving the quality of patient care. He said: "The study shows that if we are going to use data produced by hospitals to guide quality improvement, data collection systems must be carefully designed and operated, fully integrated with clinical priorities, and impose minimum burden. We need data that clinicians and organizations believe in. And until we have that, we need to be very careful about comparing performance across hospitals. We certainly need to avoid basing pay-for-performance schemes on central line data, because it's now becoming clear that these schemes have many unintended consequences."

Dr Elaine Maxwell, Assistant Director at the Health Foundation, commented: " This research highlights the very real difficulties in measuring safety in healthcare. Adverse events such as infections are increasingly being used in performance management. This study demonstrates that accurate data collection is more complex than may have at first been imagined. The Health Foundation is continuing to support the development of reliable and sensitive safety measures to reflect sustained improvement."

Explore further: International team works out secrets of one of world's most successful patient safety programs

More information: The full reference for this paper is: Dixon-Woods M, Leslie M, Bion JF, Tarrant C. What Counts? An ethnographic study of infection data reported to a patient safety program. Milbank Quarterly 2012; 90: 548-591 onlinelibrary.wiley.com/doi/10 … 012.00674.x/abstract

Related Stories

International team works out secrets of one of world's most successful patient safety programs

June 17, 2011
A team of social scientists and medical and nursing researchers in the United States and the United Kingdom has pinpointed how a program, which ran in more than 100 hospital intensive care units in Michigan, dramatically ...

Medicare penalty appears to drive hospital infection prevention efforts

May 1, 2012
The 2008 decision by the Centers for Medicare & Medicaid Services (CMS) to cease additional reimbursement to hospitals for certain healthcare-associated infections (HAIs) has led to enhanced focus on infection prevention ...

Infection control certification associated with lower MRSA infection rates

March 9, 2012
Hospitals whose infection prevention and control programs are led by a director who is board certified in infection prevention and control have significantly lower rates of methicillin-resistant Staphylococcus aureus (MRSA) ...

Proven strategies successful in reduction of deadly hospital-acquired infections

September 14, 2012
(Medical Xpress)—A new study by researchers from the Johns Hopkins University's School of Medicine and the Bloomberg School of Public Health reveals that combining several tested and proven practices for preventing central ...

Recommended for you

To reduce postoperative pain, consider sleep—and caffeine

August 18, 2017
Sleep is essential for good mental and physical health, and chronic insufficient sleep increases the risk for several chronic health problems.

Despite benefits, half of parents against later school start times

August 18, 2017
Leading pediatrics and sleep associations agree: Teens shouldn't start school so early.

Doctors exploring how to prescribe income security

August 18, 2017
Physicians at St. Michael's Hospital are studying how full-time income support workers hired by health-care clinics can help vulnerable patients or those living in poverty improve their finances and their health.

Schoolchildren who use e-cigarettes are more likely to try tobacco

August 17, 2017
Vaping - or the use of e-cigarettes - is widely accepted as a safer option for people who are already smoking.

Federal snack program does not yield expected impacts, researchers find

August 17, 2017
A well-intentioned government regulation designed to offer healthier options in school vending machines has failed to instill better snacking habits in a sample of schools in Appalachian Virginia, according to a study by ...

Study shows cigarette makers shifted stance on nicotine patches, gum

August 17, 2017
The use of nicotine patches, gum, lozenges, inhalers or nasal sprays—together called "nicotine replacement therapy," or NRT—came into play in 1984 as prescription medicine, which when combined with counseling, helped ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.