Hospitals' stroke-care rankings change markedly when stroke severity is considered

July 17, 2012

As part of the Affordable Care Act, hospitals and medical centers are required to report their quality-of-care and risk-standardized outcomes for stroke and other common medical conditions. But reporting models for mortality that don't consider stroke severity may unfairly skew these results.

Now, A UCLA-led national study has found that when reporting on 30-day for hospitalized with , using a model that adjusts for stroke severity completely alters performance outcomes and rankings for many hospitals.

The new findings, published in the July 18 issue of JAMA: The , point to the critical need to include stroke severity in models used for reporting hospitals' risk-standardized rates.

The findings are especially relevant now, since the federal Centers for and Medicaid Services and other health care payers, such as , are considering including a 30-day mortality outcomes measure for acute stroke. Such risk models and performance rankings are used to assess the quality of care at hospitals, and if facilities don't measure up, they may receive lower payments, would not be eligible for incentives and could even be fined.

Every has a different mix of cases and severity levels when it comes to stroke patients. Larger hospitals — particularly those equipped with certified stroke centers, trauma units and neurological rehabilitation programs — tend to treat the more severe cases. Patients seen at these facilities are often sicker and have additional health issues, so they generally have higher mortality rates than less severe stroke patients. If the acuity of stroke cases isn't taken into consideration, the researchers say, it can skew hospital mortality rates and outcomes measures.

"Without adjusting for stroke severity, the outcome measures may favor hospitals treating less severe strokes, regardless of whether these hospitals' approaches to patient management contributed to better or worse patient outcomes," said the study's first author, Dr. Gregg Fonarow, UCLA's Eliot Corday Professor of Cardiovascular Medicine and Science and director of the Ahmanson–UCLA Cardiomyopathy Center at the David Geffen School of Medicine at UCLA.

The research team found that more than a quarter (26.3 percent) of hospitals that ranked in the top or bottom 20 percent for risk-standardized mortality would be ranked differently using a model that adjusted for initial stroke acuity. Of those hospitals with "worse than expected" mortality, more than half were reclassified as having "as expected" mortality after adjusting for stroke severity. The researchers found that a model that utilized a stroke severity measure demonstrated greater accuracy between actual and predicted mortality rates for Medicare stroke patients than a risk model that did not.

"Outcomes measures that do not adequately discriminate stroke mortality risk may lead to rankings based on these models that distort hospital profiling and quality assessment," said study author Dr. Jeffrey Saver, a professor of neurology at the David Geffen School of Medicine at UCLA and director of the UCLA Stroke Center.

Fonarow also noted that it is important to carefully consider that rewarding or punishing hospitals for acute stroke outcomes on the basis of a risk model that doesn't account for stroke severity may misalign incentives. As a result, hospitals may consider turning away patients with more severe strokes or transferring them to other hospitals after they've been assessed by the emergency department to avoid being misclassified as having a higher mortality risk.

For the study, the researchers used data from 782 hospitals participating in the American Heart Association/American Stroke Association's Get With the Guidelines–Stroke (GWTG–Stroke) quality-improvement program between April 2003 and September 2009.

Specifically, they looked at 127,950 fee-for-service Medicare beneficiaries who were hospitalized for stroke and whose initial acuity level had been assessed with the National Institutes of Health Stroke Scale (NIH Stroke Scale), a bedside tool used by doctors and nurses to evaluate the effects of strokes on various areas, including consciousness, language, motor strength and sensory loss. The team also utilized corresponding administrative claims that were obtained from the Centers for Medicare and Services.

The team compared hospitals' 30-day mortality risk models with and without the NIH Stroke Scale information and assessed whether the hospitals performed "better than expected," "as expected" or "worse than expected." The researchers found that of the hospitals initially classified as having "worse than expected" mortality, 57.7 percent were reclassified to "as expected" mortality by the model with the NIH Stroke Scale.

"We found that a hospital's variance from its expected, risk-standardized 30-day mortality outcomes, relative to its peers, frequently changed based on which risk-adjustment model was applied," Fonarow said.

The researchers also ranked hospitals using both risk models to reflect a top 20 percent, a middle 60 percent and bottom 20 percent — all categories that are commonly used in pay-for-performance programs in which the top performers are eligible for bonus payments and the bottom performers may receive a lower penalty payment.

More than 40 percent of hospitals identified in the top or bottom 5 percent for risk-adjusted mortality would have been reclassified into the middle mortality range using a NIH Stroke Scale model, the researchers said.

"The inclusion of stroke severity may be essential for optimal ranking of hospitals with respect to 30-day mortality," Fonarow said. "Such an outcomes measure has the potential to give both patients and clinicians important feedback concerning a hospital's quality of care."

A critical question confronting clinicians, hospitals, payers and policymakers is whether current and emerging measures that assess 30-day mortality are adequate for public reporting and for use in rewarding and penalizing hospitals.

The researchers noted that not all conditions need to include a clinical severity index to achieve accurate 30-day mortality risk profiling. According to Fonarow, heart attack, heart failure and pneumonia are examples of conditions for which risk models based on health insurance claims data alone have demonstrated adequate performance when compared with clinically derived data — unlike stroke. As stroke severity has been shown to be a key determinate of outcomes, it logically follows that a measure of stroke severity would be essential for optimal discrimination of risk, he said.

Fonarow added that it may take more time and a requirement from Medicare to incorporate initial stroke severity into the data-collection system. During this study, the researchers found that the NIH Stroke Scale information was recorded for only 50.7 percent of patients hospitalized for acute nationwide.

The authors noted some limitations of the study, including the fact that only fee-for-service Medicare beneficiaries age 65 or older were studied and that outcomes other than 30-day all-cause mortality were not accessed.

Explore further: Study suggests poorer outcomes for patients with stroke hospitalized on weekends

More information:
JAMA. 2012;308[3]:257-264.
Editorial:JAMA. 2012;308[3]:292-293.

Related Stories

Study suggests poorer outcomes for patients with stroke hospitalized on weekends

July 9, 2012
A study of patients with stroke admitted to English National Health Service public hospitals suggests that patients who were hospitalized on weekends were less likely to receive urgent treatments and had worse outcomes, according ...

Treatment for minority stroke patients improves at top-ranked hospitals

June 21, 2011
After years of research have shown that minorities do not receive the same quality of health care as whites do, a new study suggests there has been some improvement in reducing the gap, at least for stroke patients.

Primary stroke centers more likely to be in states with certification programs

May 15, 2011
Searching public databases in 2010, researchers looked at the distribution of primary stroke centers, designated such by state health departments or national organizations (such as The Joint Commission in collaboration with ...

Recommended for you

Newly deciphered vitamin D regulatory pathway opens doors to clinical research

August 21, 2017
Biochemists at the University of Wisconsin–Madison have deciphered the molecular mechanisms that underpin how the synthesis of the active form of vitamin D is regulated in the kidney, summing up decades of research in this ...

Clay-based antimicrobial packaging keeps food fresh

August 21, 2017
Sometimes it seems as if fresh fruits, vegetables and meats go bad in the blink of an eye. Consumers are left feeling frustrated, often turning to less expensive processed foods that last longer but are less nutritious. Now ...

Despite benefits, half of parents against later school start times

August 18, 2017
Leading pediatrics and sleep associations agree: Teens shouldn't start school so early.

Doctors exploring how to prescribe income security

August 18, 2017
Physicians at St. Michael's Hospital are studying how full-time income support workers hired by health-care clinics can help vulnerable patients or those living in poverty improve their finances and their health.

Schoolchildren who use e-cigarettes are more likely to try tobacco

August 17, 2017
Vaping - or the use of e-cigarettes - is widely accepted as a safer option for people who are already smoking.

Federal snack program does not yield expected impacts, researchers find

August 17, 2017
A well-intentioned government regulation designed to offer healthier options in school vending machines has failed to instill better snacking habits in a sample of schools in Appalachian Virginia, according to a study by ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.