Hospitals' stroke-care rankings change markedly when stroke severity is considered

July 17, 2012

As part of the Affordable Care Act, hospitals and medical centers are required to report their quality-of-care and risk-standardized outcomes for stroke and other common medical conditions. But reporting models for mortality that don't consider stroke severity may unfairly skew these results.

Now, A UCLA-led national study has found that when reporting on 30-day for hospitalized with , using a model that adjusts for stroke severity completely alters performance outcomes and rankings for many hospitals.

The new findings, published in the July 18 issue of JAMA: The , point to the critical need to include stroke severity in models used for reporting hospitals' risk-standardized rates.

The findings are especially relevant now, since the federal Centers for and Medicaid Services and other health care payers, such as , are considering including a 30-day mortality outcomes measure for acute stroke. Such risk models and performance rankings are used to assess the quality of care at hospitals, and if facilities don't measure up, they may receive lower payments, would not be eligible for incentives and could even be fined.

Every has a different mix of cases and severity levels when it comes to stroke patients. Larger hospitals — particularly those equipped with certified stroke centers, trauma units and neurological rehabilitation programs — tend to treat the more severe cases. Patients seen at these facilities are often sicker and have additional health issues, so they generally have higher mortality rates than less severe stroke patients. If the acuity of stroke cases isn't taken into consideration, the researchers say, it can skew hospital mortality rates and outcomes measures.

"Without adjusting for stroke severity, the outcome measures may favor hospitals treating less severe strokes, regardless of whether these hospitals' approaches to patient management contributed to better or worse patient outcomes," said the study's first author, Dr. Gregg Fonarow, UCLA's Eliot Corday Professor of Cardiovascular Medicine and Science and director of the Ahmanson–UCLA Cardiomyopathy Center at the David Geffen School of Medicine at UCLA.

The research team found that more than a quarter (26.3 percent) of hospitals that ranked in the top or bottom 20 percent for risk-standardized mortality would be ranked differently using a model that adjusted for initial stroke acuity. Of those hospitals with "worse than expected" mortality, more than half were reclassified as having "as expected" mortality after adjusting for stroke severity. The researchers found that a model that utilized a stroke severity measure demonstrated greater accuracy between actual and predicted mortality rates for Medicare stroke patients than a risk model that did not.

"Outcomes measures that do not adequately discriminate stroke mortality risk may lead to rankings based on these models that distort hospital profiling and quality assessment," said study author Dr. Jeffrey Saver, a professor of neurology at the David Geffen School of Medicine at UCLA and director of the UCLA Stroke Center.

Fonarow also noted that it is important to carefully consider that rewarding or punishing hospitals for acute stroke outcomes on the basis of a risk model that doesn't account for stroke severity may misalign incentives. As a result, hospitals may consider turning away patients with more severe strokes or transferring them to other hospitals after they've been assessed by the emergency department to avoid being misclassified as having a higher mortality risk.

For the study, the researchers used data from 782 hospitals participating in the American Heart Association/American Stroke Association's Get With the Guidelines–Stroke (GWTG–Stroke) quality-improvement program between April 2003 and September 2009.

Specifically, they looked at 127,950 fee-for-service Medicare beneficiaries who were hospitalized for stroke and whose initial acuity level had been assessed with the National Institutes of Health Stroke Scale (NIH Stroke Scale), a bedside tool used by doctors and nurses to evaluate the effects of strokes on various areas, including consciousness, language, motor strength and sensory loss. The team also utilized corresponding administrative claims that were obtained from the Centers for Medicare and Services.

The team compared hospitals' 30-day mortality risk models with and without the NIH Stroke Scale information and assessed whether the hospitals performed "better than expected," "as expected" or "worse than expected." The researchers found that of the hospitals initially classified as having "worse than expected" mortality, 57.7 percent were reclassified to "as expected" mortality by the model with the NIH Stroke Scale.

"We found that a hospital's variance from its expected, risk-standardized 30-day mortality outcomes, relative to its peers, frequently changed based on which risk-adjustment model was applied," Fonarow said.

The researchers also ranked hospitals using both risk models to reflect a top 20 percent, a middle 60 percent and bottom 20 percent — all categories that are commonly used in pay-for-performance programs in which the top performers are eligible for bonus payments and the bottom performers may receive a lower penalty payment.

More than 40 percent of hospitals identified in the top or bottom 5 percent for risk-adjusted mortality would have been reclassified into the middle mortality range using a NIH Stroke Scale model, the researchers said.

"The inclusion of stroke severity may be essential for optimal ranking of hospitals with respect to 30-day mortality," Fonarow said. "Such an outcomes measure has the potential to give both patients and clinicians important feedback concerning a hospital's quality of care."

A critical question confronting clinicians, hospitals, payers and policymakers is whether current and emerging measures that assess 30-day mortality are adequate for public reporting and for use in rewarding and penalizing hospitals.

The researchers noted that not all conditions need to include a clinical severity index to achieve accurate 30-day mortality risk profiling. According to Fonarow, heart attack, heart failure and pneumonia are examples of conditions for which risk models based on health insurance claims data alone have demonstrated adequate performance when compared with clinically derived data — unlike stroke. As stroke severity has been shown to be a key determinate of outcomes, it logically follows that a measure of stroke severity would be essential for optimal discrimination of risk, he said.

Fonarow added that it may take more time and a requirement from Medicare to incorporate initial stroke severity into the data-collection system. During this study, the researchers found that the NIH Stroke Scale information was recorded for only 50.7 percent of patients hospitalized for acute nationwide.

The authors noted some limitations of the study, including the fact that only fee-for-service Medicare beneficiaries age 65 or older were studied and that outcomes other than 30-day all-cause mortality were not accessed.

Explore further: Study suggests poorer outcomes for patients with stroke hospitalized on weekends

More information:
JAMA. 2012;308[3]:257-264.
Editorial:JAMA. 2012;308[3]:292-293.

Related Stories

Study suggests poorer outcomes for patients with stroke hospitalized on weekends

July 9, 2012
A study of patients with stroke admitted to English National Health Service public hospitals suggests that patients who were hospitalized on weekends were less likely to receive urgent treatments and had worse outcomes, according ...

Treatment for minority stroke patients improves at top-ranked hospitals

June 21, 2011
After years of research have shown that minorities do not receive the same quality of health care as whites do, a new study suggests there has been some improvement in reducing the gap, at least for stroke patients.

Primary stroke centers more likely to be in states with certification programs

May 15, 2011
Searching public databases in 2010, researchers looked at the distribution of primary stroke centers, designated such by state health departments or national organizations (such as The Joint Commission in collaboration with ...

Recommended for you

Mistletoe and (a large) wine: Seven-fold increase in wine glass size over 300 years

December 13, 2017
Our Georgian and Victorian ancestors probably celebrated Christmas with more modest wine consumption than we do today - if the size of their wine glasses are anything to go by. Researchers at the University of Cambridge have ...

Searching for a link between achy joints and rainy weather in a flood of data, researchers come up dry

December 13, 2017
Rainy weather has long been blamed for achy joints. Unjustly so, according to new research from Harvard Medical School. The analysis, published Dec. 13 in BMJ, found no relationship between rainfall and joint or back pain.

How well can digital assistants answer questions on sex?

December 13, 2017
Google laptop searches seem to be better at finding quality online sexual health advice than digital assistants on smartphones, find experts in the Christmas issue of The BMJ.

Owning a pet does not seem to influence signs of aging

December 13, 2017
Owning a pet does not appear to slow the rate of ageing, as measured by standard indicators, suggest the authors of a study published in the Christmas issue of The BMJ.

Increased air pollution linked to bad teenage behavior

December 13, 2017
A new study linking higher levels of air pollution to increased teenage delinquency is a reminder of the importance of clean air and the need for more foliage in urban spaces, a Keck School of Medicine of USC researcher said.

175 years on, study finds where you live still determines your life expectancy

December 13, 2017
Research led by the University of Liverpool has revisited a study carried out 175 years ago which compared the health and life expectancy of people in different parts of the country, including Liverpool, to see if its findings ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.