Study examines accuracy of prognostic tools used to predict mortality among older adults

January 10, 2012, JAMA and Archives Journals

A review of 16 prognostic indices used to predict risk of death in older adults in a variety of clinical settings, such as in nursing homes and hospitals, found that there is insufficient evidence to recommend the widespread use of these indices in clinical practice, according to a study in the January 11 issue of JAMA.

"Failure to consider prognosis in the context of clinical can lead to poor care. Hospice is underutilized for patients with nonmalignant yet life-threatening diseases. Healthy older patients with good have low rates of cancer screening. Older adults with advanced dementia or are screened for slow-growing cancers that are unlikely to ever cause them symptoms but may lead to distress from false-positive results, invasive workups, and treatments," according to background information in the article. "In recognition of these phenomena, guidelines increasingly incorporate life expectancy as a central factor in weighing the benefits and the burdens of tests and treatments. Prognostic indices offer a potential role for moving beyond arbitrary age-based cutoffs in clinical decision making for older adults. However, little is known about the quality of prognostic indices for older adults, limiting their clinical use."

Lindsey C. Yourman, M.D., of the University of California, San Francisco, and colleagues conducted a systematic review to examine the quality and limitations of validated non-disease-specific prognostic indices that predict absolute risk of all-cause mortality in patients whose average age was 60 years or older. A review of the identified 16 indices that predict risk of mortality from 6 months to 5 years for in a variety of : the community (6 indices), nursing home (2 indices), and hospital (8 indices; 5 were intended for use in the or on and 3 after ). Studies were abstracted for information about index quality, including potential for bias, generalizability, and accuracy.

All indices were developed using secondary analysis of existing data sets of participants from the United States and western Europe. The most common final predictors of mortality included functional status and co-existing illnesses. The researchers found that at least 1 measure of transportability (the index is accurate in more than 1 population) was tested for all but 3 indices. By the measures used, no study was free from potential bias. Only 2 indices were independently validated by investigators who were not involved in the development of the index. No index had been prospectively tested and found to be accurate in a large diverse sample. "These factors limit a clinician's ability to assess the accuracy of these indices across patient groups that differ according to severity of illness, methodology of data collection, geographic location, and time," the authors write.

The researchers add that even if quality barriers are overcome, important limitations remain, such as indices requiring collection of information that may not be routinely assessed in elderly patients, like activities of daily living. They add that many of these indices rely on clinical information from administrative data sets, and the accuracy of certain codes has been called into question.

"Ultimately, an index will be judged not only on its accuracy across diverse settings, but also on its clinical effect. Studies that demonstrate effect on prognostic estimates, clinician behavior, and patient outcomes have a higher level of evidence for use in clinical decision making. We are aware of only 2 small studies that tested the effect of these indices on clinical outcomes. The highest level of evidence, however, would come from large prospective trials that randomize clinicians to using the index or not, evaluating the effect of the index on prognostic estimates, clinical decision making, and patient outcomes. Such large randomized trials have not been performed," the authors write.

"While neither a clinician nor an index can predict with absolute certainty how long an older adult will live, validated prognostic indices might improve the accuracy of the prognostic assumptions that influence clinical decisions. However, further research is needed before general prognostic indices for elderly individuals can be recommended for routine use. Future research should focus on prospectively testing the validity of these indices across diverse clinical settings and analyzing their effect on making and patient outcomes."

"From a research perspective, new prognostic indices should be developed and validated based on life expectancy rather than mortality risk," writes Thomas M. Gill, M.D., of the Yale School of Medicine, New Haven, Conn., in an accompanying editorial.

"The clinical utility of the most promising life expectancy indices should be evaluated in well-designed studies. When developing a new prognostic index, investigators should focus on data elements that are readily accessible and recordable in the electronic medical record, allowing for real-time estimates of life expectancy. The incremental benefit of factors beyond age, sex, smoking history, and body mass index, which are included in most mortality prognostic indices, should be carefully evaluated to determine whether the gain in accuracy outweighs the added burden of data collection."

Explore further: New score can tell doctors how long cancer patients have left to live

More information: JAMA. 2012;307[2]:182-192.
JAMA. 2012;307[2]:199-200.

Related Stories

New score can tell doctors how long cancer patients have left to live

August 26, 2011
A new scoring system can more reliably predict whether patients with advanced cancer are likely to survive for "days", "weeks" or "months" finds a study published in the British Medical Journal today.

Recommended for you

Best of Last Year—The top Medical Xpress articles of 2017

December 20, 2017
It was a good year for medical research as a team at the German center for Neurodegenerative Diseases, Magdeburg, found that dancing can reverse the signs of aging in the brain. Any exercise helps, the team found, but dancing ...

Pickled in 'cognac', Chopin's heart gives up its secrets

November 26, 2017
The heart of Frederic Chopin, among the world's most cherished musical virtuosos, may finally have given up the cause of his untimely death.

Sugar industry withheld evidence of sucrose's health effects nearly 50 years ago

November 21, 2017
A U.S. sugar industry trade group appears to have pulled the plug on a study that was producing animal evidence linking sucrose to disease nearly 50 years ago, researchers argue in a paper publishing on November 21 in the ...

Female researchers pay more attention to sex and gender in medicine

November 7, 2017
When women participate in a medical research paper, that research is more likely to take into account the differences between the way men and women react to diseases and treatments, according to a new study by Stanford researchers.

Drug therapy from lethal bacteria could reduce kidney transplant rejection

August 3, 2017
An experimental treatment derived from a potentially deadly microorganism may provide lifesaving help for kidney transplant patients, according to an international study led by investigators at Cedars-Sinai.

Exploring the potential of human echolocation

June 25, 2017
People who are visually impaired will often use a cane to feel out their surroundings. With training and practice, people can learn to use the pitch, loudness and timbre of echoes from the cane or other sounds to navigate ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.