Study examines accuracy of prognostic tools used to predict mortality among older adults

January 10, 2012

A review of 16 prognostic indices used to predict risk of death in older adults in a variety of clinical settings, such as in nursing homes and hospitals, found that there is insufficient evidence to recommend the widespread use of these indices in clinical practice, according to a study in the January 11 issue of JAMA.

"Failure to consider prognosis in the context of clinical can lead to poor care. Hospice is underutilized for patients with nonmalignant yet life-threatening diseases. Healthy older patients with good have low rates of cancer screening. Older adults with advanced dementia or are screened for slow-growing cancers that are unlikely to ever cause them symptoms but may lead to distress from false-positive results, invasive workups, and treatments," according to background information in the article. "In recognition of these phenomena, guidelines increasingly incorporate life expectancy as a central factor in weighing the benefits and the burdens of tests and treatments. Prognostic indices offer a potential role for moving beyond arbitrary age-based cutoffs in clinical decision making for older adults. However, little is known about the quality of prognostic indices for older adults, limiting their clinical use."

Lindsey C. Yourman, M.D., of the University of California, San Francisco, and colleagues conducted a systematic review to examine the quality and limitations of validated non-disease-specific prognostic indices that predict absolute risk of all-cause mortality in patients whose average age was 60 years or older. A review of the identified 16 indices that predict risk of mortality from 6 months to 5 years for in a variety of : the community (6 indices), nursing home (2 indices), and hospital (8 indices; 5 were intended for use in the or on and 3 after ). Studies were abstracted for information about index quality, including potential for bias, generalizability, and accuracy.

All indices were developed using secondary analysis of existing data sets of participants from the United States and western Europe. The most common final predictors of mortality included functional status and co-existing illnesses. The researchers found that at least 1 measure of transportability (the index is accurate in more than 1 population) was tested for all but 3 indices. By the measures used, no study was free from potential bias. Only 2 indices were independently validated by investigators who were not involved in the development of the index. No index had been prospectively tested and found to be accurate in a large diverse sample. "These factors limit a clinician's ability to assess the accuracy of these indices across patient groups that differ according to severity of illness, methodology of data collection, geographic location, and time," the authors write.

The researchers add that even if quality barriers are overcome, important limitations remain, such as indices requiring collection of information that may not be routinely assessed in elderly patients, like activities of daily living. They add that many of these indices rely on clinical information from administrative data sets, and the accuracy of certain codes has been called into question.

"Ultimately, an index will be judged not only on its accuracy across diverse settings, but also on its clinical effect. Studies that demonstrate effect on prognostic estimates, clinician behavior, and patient outcomes have a higher level of evidence for use in clinical decision making. We are aware of only 2 small studies that tested the effect of these indices on clinical outcomes. The highest level of evidence, however, would come from large prospective trials that randomize clinicians to using the index or not, evaluating the effect of the index on prognostic estimates, clinical decision making, and patient outcomes. Such large randomized trials have not been performed," the authors write.

"While neither a clinician nor an index can predict with absolute certainty how long an older adult will live, validated prognostic indices might improve the accuracy of the prognostic assumptions that influence clinical decisions. However, further research is needed before general prognostic indices for elderly individuals can be recommended for routine use. Future research should focus on prospectively testing the validity of these indices across diverse clinical settings and analyzing their effect on making and patient outcomes."

"From a research perspective, new prognostic indices should be developed and validated based on life expectancy rather than mortality risk," writes Thomas M. Gill, M.D., of the Yale School of Medicine, New Haven, Conn., in an accompanying editorial.

"The clinical utility of the most promising life expectancy indices should be evaluated in well-designed studies. When developing a new prognostic index, investigators should focus on data elements that are readily accessible and recordable in the electronic medical record, allowing for real-time estimates of life expectancy. The incremental benefit of factors beyond age, sex, smoking history, and body mass index, which are included in most mortality prognostic indices, should be carefully evaluated to determine whether the gain in accuracy outweighs the added burden of data collection."

Explore further: New score can tell doctors how long cancer patients have left to live

More information: JAMA. 2012;307[2]:182-192.
JAMA. 2012;307[2]:199-200.

Related Stories

New score can tell doctors how long cancer patients have left to live

August 26, 2011
A new scoring system can more reliably predict whether patients with advanced cancer are likely to survive for "days", "weeks" or "months" finds a study published in the British Medical Journal today.

Recommended for you

Exploring the potential of human echolocation

June 25, 2017
People who are visually impaired will often use a cane to feel out their surroundings. With training and practice, people can learn to use the pitch, loudness and timbre of echoes from the cane or other sounds to navigate ...

Team eradicates hepatitis C in 10 patients following lifesaving transplants from infected donors

April 30, 2017
Ten patients at Penn Medicine have been cured of the Hepatitis C virus (HCV) following lifesaving kidney transplants from deceased donors who were infected with the disease. The findings point to new strategies for increasing ...

'bench to bedside to bench': Scientists call for closer basic-clinical collaborations

March 24, 2017
In the era of genome sequencing, it's time to update the old "bench-to-bedside" shorthand for how basic research discoveries inform clinical practice, researchers from The Jackson Laboratory (JAX), National Human Genome Research ...

The ethics of tracking athletes' biometric data

January 18, 2017
(Medical Xpress)—Whether it is a FitBit or a heart rate monitor, biometric technologies have become household devices. Professional sports leagues use some of the most technologically advanced biodata tracking systems to ...

Financial ties between researchers and drug industry linked to positive trial results

January 18, 2017
Financial ties between researchers and companies that make the drugs they are studying are independently associated with positive trial results, suggesting bias in the evidence base, concludes a study published by The BMJ ...

Best of Last Year – The top Medical Xpress articles of 2016

December 23, 2016
(Medical Xpress)—It was a big year for research involving overall health issues, starting with a team led by researchers at the UNC School of Medicine and the National Institutes of Health who unearthed more evidence that ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.