Online ratings don't help patients compare hospitals

March 19, 2014 by Stephanie Stephens
Online ratings don't help patients compare hospitals

Despite having access to online ratings, patients can't distinguish the quality or performance of one hospital from another, finds a new study in Health Services Research.

"The U.S. Department of Health and Human Services website,'s Hospital Compare, seeks to provide patients with actionable, relevant information regarding the quality of the in their own area," said lead study author Kyan Cyrus Safavi, M.D., M.B.A. at Yale University School of Medicine. Safavi and his co-authors wondered whether Hospital Compare's ratings allowed patients to distinguish a top-performing hospital in a local area, and then "to make an intelligent data-driven decision."

"Since it's important to empower patients to make better decisions about where they seek care, we wanted to know more about how that process is really going—and what kind of data they really see," he added.

On the Hospital Compare website, patients have access to data about a collection of surgical process of care measures from the Surgical Care Improvement Project (SCIP), Safavi explained. SCIP is a national partnership of organizations interested in improving by significantly reducing surgical complications, in particular, .

The researchers found that the nearly 3,000 hospitals across the U.S that reported SCIP data, generally performed well with little variation, making it difficult for patients to differentiate between hospitals in their region.

"The pattern held across many diverse regional geographic areas nationwide," Safavi said. "Patients use this type of data frequently, especially when making decisions about elective or semi-elective surgeries. There's a missed opportunity to provide those patients with more transparent and reliable information to better influence their decision-making."

Measuring other processes of care, however, can help distinguish between hospitals, he said. "For example, what is the organization and safety of the operating environment, and how much attention is a paying to post-surgical wound care? Hospital outcomes can also distinguish quality."

Richard P. Dutton, M.D., M.B.A. and executive director of the Anesthesia Quality Institute, agreed that more attention could be paid to the bigger picture.

"This article illustrates a common pitfall with public reporting: measures that can be documented and risk adjusted adequately to support fair publication may represent only a small factor in the patient's outcome," he said. "Things that matter more, such as perioperative mortality [mortality during admission, anesthesia, surgery and recovery], or the actual occurrence of a surgical site infection, are harder to measure fairly and much harder to risk adjust."

What's not emphasized in the article, however, is the benefit of a focused improvement in care in one specific area, Dutton said. "That hospitals nationwide have achieved 98 percent compliance with these SCIP measures likely represents a substantial improvement in systems and safety that is itself a laudable achievement."

Explore further: Hospital readmission rates linked with quality of surgical care

More information: Safavi, K. C., Dai, F., Gilbertsen, T. A. and Schonberger, R. B. (2014), "Variation in Surgical Quality Measure Adherence within Hospital Referral Regions: Do Publicly Reported Surgical Quality Measures Distinguish among Hospitals That Patients Are Likely to Compare?" Health Services Research. doi: 10.1111/1475-6773.12164

Related Stories

Hospital readmission rates linked with quality of surgical care

September 18, 2013

Reducing hospital readmission rates is an important clinical and policy priority but whether those rates really measure the quality of hospital care isn't clear. In a new study, researchers from Harvard School of Public Health ...

Patient participation in surgical safety checklist effective

January 27, 2014

Patients feel safer – and likely are safer – when they receive a surgical safety checklist and request that their health care providers use it, suggests a pilot study being presented at the American Society of Anesthesiologists ...

Complications following surgery predict costly readmissions

March 6, 2014

or absence – of complications following surgery is a strong indicator of which patients are likely to be readmitted to the hospital in the 30 days following their procedure, according to a study published today in JAMA ...

Chronic hyperglycemia tied to worse surgical outcomes

March 16, 2014

(HealthDay)—Chronic hyperglycemia (A1C >8 percent) is associated with poor surgical outcomes, as measured by an increased hospital length of stay (LOS), according to a study published in the March issue of Diabetes Care.

Recommended for you

Mobile app records our erratic eating habits

September 24, 2015

Breakfast, lunch, and dinner? For too many of us, the three meals of the day go more like: office meeting pastry, mid-afternoon energy drink, and midnight pizza. In Cell Metabolism on September 24, Salk Institute scientists ...

1 comment

Adjust slider to filter visible comments by rank

Display comments: newest first

not rated yet Mar 19, 2014
The AMA and the hospitals are against allowing patients to see such information as how many lawsuits have been filed for malpractice, how many patient deaths are associated with a doctor or hospital, etc. That might lead to some doctors not getting any work and we cannot have that.

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.