Study examines accuracy of prognostic tools used to predict mortality among older adults

A review of 16 prognostic indices used to predict risk of death in older adults in a variety of clinical settings, such as in nursing homes and hospitals, found that there is insufficient evidence to recommend the widespread use of these indices in clinical practice, according to a study in the January 11 issue of JAMA.

"Failure to consider prognosis in the context of clinical can lead to poor care. Hospice is underutilized for patients with nonmalignant yet life-threatening diseases. Healthy older patients with good have low rates of cancer screening. Older adults with advanced dementia or are screened for slow-growing cancers that are unlikely to ever cause them symptoms but may lead to distress from false-positive results, invasive workups, and treatments," according to background information in the article. "In recognition of these phenomena, guidelines increasingly incorporate life expectancy as a central factor in weighing the benefits and the burdens of tests and treatments. Prognostic indices offer a potential role for moving beyond arbitrary age-based cutoffs in clinical decision making for older adults. However, little is known about the quality of prognostic indices for older adults, limiting their clinical use."

Lindsey C. Yourman, M.D., of the University of California, San Francisco, and colleagues conducted a systematic review to examine the quality and limitations of validated non-disease-specific prognostic indices that predict absolute risk of all-cause mortality in patients whose average age was 60 years or older. A review of the identified 16 indices that predict risk of mortality from 6 months to 5 years for in a variety of : the community (6 indices), nursing home (2 indices), and hospital (8 indices; 5 were intended for use in the or on and 3 after ). Studies were abstracted for information about index quality, including potential for bias, generalizability, and accuracy.

All indices were developed using secondary analysis of existing data sets of participants from the United States and western Europe. The most common final predictors of mortality included functional status and co-existing illnesses. The researchers found that at least 1 measure of transportability (the index is accurate in more than 1 population) was tested for all but 3 indices. By the measures used, no study was free from potential bias. Only 2 indices were independently validated by investigators who were not involved in the development of the index. No index had been prospectively tested and found to be accurate in a large diverse sample. "These factors limit a clinician's ability to assess the accuracy of these indices across patient groups that differ according to severity of illness, methodology of data collection, geographic location, and time," the authors write.

The researchers add that even if quality barriers are overcome, important limitations remain, such as indices requiring collection of information that may not be routinely assessed in elderly patients, like activities of daily living. They add that many of these indices rely on clinical information from administrative data sets, and the accuracy of certain codes has been called into question.

"Ultimately, an index will be judged not only on its accuracy across diverse settings, but also on its clinical effect. Studies that demonstrate effect on prognostic estimates, clinician behavior, and patient outcomes have a higher level of evidence for use in clinical decision making. We are aware of only 2 small studies that tested the effect of these indices on clinical outcomes. The highest level of evidence, however, would come from large prospective trials that randomize clinicians to using the index or not, evaluating the effect of the index on prognostic estimates, clinical decision making, and patient outcomes. Such large randomized trials have not been performed," the authors write.

"While neither a clinician nor an index can predict with absolute certainty how long an older adult will live, validated prognostic indices might improve the accuracy of the prognostic assumptions that influence clinical decisions. However, further research is needed before general prognostic indices for elderly individuals can be recommended for routine use. Future research should focus on prospectively testing the validity of these indices across diverse clinical settings and analyzing their effect on making and patient outcomes."

"From a research perspective, new prognostic indices should be developed and validated based on life expectancy rather than mortality risk," writes Thomas M. Gill, M.D., of the Yale School of Medicine, New Haven, Conn., in an accompanying editorial.

"The clinical utility of the most promising life expectancy indices should be evaluated in well-designed studies. When developing a new prognostic index, investigators should focus on data elements that are readily accessible and recordable in the electronic medical record, allowing for real-time estimates of life expectancy. The incremental benefit of factors beyond age, sex, smoking history, and body mass index, which are included in most mortality prognostic indices, should be carefully evaluated to determine whether the gain in accuracy outweighs the added burden of data collection."

More information: JAMA. 2012;307[2]:182-192.
JAMA. 2012;307[2]:199-200.

add to favorites email to friend print save as pdf

Related Stories

New tool to predict the risk of death in COPD

Aug 28, 2009

Researchers have developed an index scale to help physicians predict a patient's risk of dying from chronic obstructive pulmonary disease (COPD). The ADO index can help physicians assess the severity of a patient's illness ...

Recommended for you

Doctor behind 'free radical' aging theory dies

Nov 25, 2014

Dr. Denham Harman, a renowned scientist who developed the most widely accepted theory on aging that's now used to study cancer, Alzheimer's disease and other illnesses, has died in Nebraska at age 98.

Mexican boy who had massive tumor recovering

Nov 25, 2014

An 11-year-old Mexican boy who had pieces of a massive tumor removed and who drew international attention after U.S. officials helped him get treatment in the southwestern U.S. state of New Mexico is still recovering after ...

New medical device to make the mines safer

Nov 21, 2014

Dehydration can be a serious health issue for Australia's mining industry, but a new product to be developed with input from Flinders University's Medical Device Partnering Program (MDPP) is set to more effectively ...

US family gets $6.75 million in Botox case

Nov 20, 2014

A New York couple who said Botox treatment of their son's cerebral palsy left him with life-threatening complications and sued its manufacturer won a $6.75 million verdict from a federal jury on Thursday.

User comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.