Online ratings don't help patients compare hospitals

March 19, 2014 by Stephanie Stephens
Online ratings don't help patients compare hospitals

Despite having access to online ratings, patients can't distinguish the quality or performance of one hospital from another, finds a new study in Health Services Research.

"The U.S. Department of Health and Human Services website,'s Hospital Compare, seeks to provide patients with actionable, relevant information regarding the quality of the in their own area," said lead study author Kyan Cyrus Safavi, M.D., M.B.A. at Yale University School of Medicine. Safavi and his co-authors wondered whether Hospital Compare's ratings allowed patients to distinguish a top-performing hospital in a local area, and then "to make an intelligent data-driven decision."

"Since it's important to empower patients to make better decisions about where they seek care, we wanted to know more about how that process is really going—and what kind of data they really see," he added.

On the Hospital Compare website, patients have access to data about a collection of surgical process of care measures from the Surgical Care Improvement Project (SCIP), Safavi explained. SCIP is a national partnership of organizations interested in improving by significantly reducing surgical complications, in particular, .

The researchers found that the nearly 3,000 hospitals across the U.S that reported SCIP data, generally performed well with little variation, making it difficult for patients to differentiate between hospitals in their region.

"The pattern held across many diverse regional geographic areas nationwide," Safavi said. "Patients use this type of data frequently, especially when making decisions about elective or semi-elective surgeries. There's a missed opportunity to provide those patients with more transparent and reliable information to better influence their decision-making."

Measuring other processes of care, however, can help distinguish between hospitals, he said. "For example, what is the organization and safety of the operating environment, and how much attention is a paying to post-surgical wound care? Hospital outcomes can also distinguish quality."

Richard P. Dutton, M.D., M.B.A. and executive director of the Anesthesia Quality Institute, agreed that more attention could be paid to the bigger picture.

"This article illustrates a common pitfall with public reporting: measures that can be documented and risk adjusted adequately to support fair publication may represent only a small factor in the patient's outcome," he said. "Things that matter more, such as perioperative mortality [mortality during admission, anesthesia, surgery and recovery], or the actual occurrence of a surgical site infection, are harder to measure fairly and much harder to risk adjust."

What's not emphasized in the article, however, is the benefit of a focused improvement in care in one specific area, Dutton said. "That hospitals nationwide have achieved 98 percent compliance with these SCIP measures likely represents a substantial improvement in systems and safety that is itself a laudable achievement."

Explore further: Complications following surgery predict costly readmissions

More information: Safavi, K. C., Dai, F., Gilbertsen, T. A. and Schonberger, R. B. (2014), "Variation in Surgical Quality Measure Adherence within Hospital Referral Regions: Do Publicly Reported Surgical Quality Measures Distinguish among Hospitals That Patients Are Likely to Compare?" Health Services Research. doi: 10.1111/1475-6773.12164

Related Stories

Complications following surgery predict costly readmissions

March 6, 2014
or absence – of complications following surgery is a strong indicator of which patients are likely to be readmitted to the hospital in the 30 days following their procedure, according to a study published today in JAMA ...

Hospital readmission rates linked with quality of surgical care

September 18, 2013
Reducing hospital readmission rates is an important clinical and policy priority but whether those rates really measure the quality of hospital care isn't clear. In a new study, researchers from Harvard School of Public Health ...

Chronic hyperglycemia tied to worse surgical outcomes

March 16, 2014
(HealthDay)—Chronic hyperglycemia (A1C >8 percent) is associated with poor surgical outcomes, as measured by an increased hospital length of stay (LOS), according to a study published in the March issue of Diabetes Care.

Study finds low rate of surgical site infections following ambulatory surgery

February 18, 2014
In an analysis that included nearly 300,000 patients from eight states who underwent ambulatory surgery (surgery performed on a person who is admitted to and discharged from a hospital on the same day), researchers found ...

Patient participation in surgical safety checklist effective

January 27, 2014
Patients feel safer – and likely are safer – when they receive a surgical safety checklist and request that their health care providers use it, suggests a pilot study being presented at the American Society of Anesthesiologists ...

Recommended for you

Brain disease seen in most football players in large report

July 25, 2017
Research on 202 former football players found evidence of a brain disease linked to repeated head blows in nearly all of them, from athletes in the National Football League, college and even high school.

Safety of medical devices not often evaluated by sex, age, or race

July 25, 2017
Researchers at Yale and the University of California-San Francisco have found that few medical devices are analyzed to consider the influence of their users' sex, age, or race on safety and effectiveness.

Why you should consider more than looks when choosing a fitness tracker

July 25, 2017
A UNSW study of five popular physical activity monitors, including Fitbit and Jawbone models, has found their accuracy differs with the speed of activity, and where they are worn.

Dog walking could be key to ensuring activity in later life

July 24, 2017
A new study has shown that regularly walking a dog boosts levels of physical activity in older people, especially during the winter.

Alcohol to claim 63,000 lives over next five years, experts warn

July 24, 2017
Alcohol consumption will cause 63,000 deaths in England over the next five years – the equivalent of 35 deaths a day – according to a new report from the University of Sheffield Alcohol Research Group.

Alcohol boosts recall of earlier learning

July 24, 2017
Drinking alcohol improves memory for information learned before the drinking episode began, new research suggests.

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Mar 19, 2014
The AMA and the hospitals are against allowing patients to see such information as how many lawsuits have been filed for malpractice, how many patient deaths are associated with a doctor or hospital, etc. That might lead to some doctors not getting any work and we cannot have that.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.