AI systems found to be better than doctors at gauging heart attack risk

April 17, 2017 by Bob Yirka report
Credit: CC0 Public Domain

(Medical Xpress)—A team of researchers at the University of Nottingham in the U.K. has found that artificial intelligence systems can be better at gauging a patient's risk of a heart attack than doctors using a standard protocol. In their paper uploaded to the open access site PLOS ONE, the team describes how they tested four AI systems against humans using a protocol, what they found, and why they believe there is still room for improvement.

Most doctors today use a protocol or guideline very much like the one created by the American College of Cardiology/American Heart Association (ACC/AHA). It is essentially a questionnaire assessing and generating a statistical result. The guideline accounts for such factors as a patient's age, weight, blood pressure and cholesterol levels. Prior research has shown that by using such a guideline, doctors can correctly assess a patient's risk of having a heart attack at a rate of 72.8 percent, which is quite impressive. But it still leaves a lot of room for improvement, because that failure rate of 27.2 percent oftentimes represents people who die.

In this new effort, the researchers sought to find out if computers running AI systems might do a better job of it. They set up four such AI systems: logistic regression, random forest, neural networks and gradient boosting. Each was given thousands of patient data records from a British medical database as a means to study health patterns in patients and to identify . They were then each assigned the task of predicting a heart attack in those same patients over the course of the next 10 years—the data covered the period 2005 to 2015.

The researchers report that all four AI systems did better than the human average using the ACC/AHA guidelines, ranging from 74.5 percent to 76.4 percent correct, which, the team noted, possibly amounted to 355 patients whose lives could have been saved had they known they were at risk. They report also that the systems found risk factors that are not currently used by doctors to assess risk, such as mental illness and the use of oral corticosteroids. They suggest that tweaking the system and perhaps adding other known risks manually could improve the rate even more.

Explore further: Study finds most major heart attacks occur in people with normal cholesterol

More information: Stephen F. Weng et al. Can machine-learning improve cardiovascular risk prediction using routine clinical data?, PLOS ONE (2017). DOI: 10.1371/journal.pone.0174944

Abstract

Background
Current approaches to predict cardiovascular risk fail to identify many people who would benefit from preventive treatment, while others receive unnecessary intervention. Machine-learning offers opportunity to improve accuracy by exploiting complex interactions between risk factors. We assessed whether machine-learning can improve cardiovascular risk prediction.

Methods
Prospective cohort study using routine clinical data of 378,256 patients from UK family practices, free from cardiovascular disease at outset. Four machine-learning algorithms (random forest, logistic regression, gradient boosting machines, neural networks) were compared to an established algorithm (American College of Cardiology guidelines) to predict first cardiovascular event over 10-years. Predictive accuracy was assessed by area under the 'receiver operating curve' (AUC); and sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) to predict 7.5% cardiovascular risk (threshold for initiating statins).

Findings
24,970 incident cardiovascular events (6.6%) occurred. Compared to the established risk prediction algorithm (AUC 0.728, 95% CI 0.723–0.735), machine-learning algorithms improved prediction: random forest +1.7% (AUC 0.745, 95% CI 0.739–0.750), logistic regression +3.2% (AUC 0.760, 95% CI 0.755–0.766), gradient boosting +3.3% (AUC 0.761, 95% CI 0.755–0.766), neural networks +3.6% (AUC 0.764, 95% CI 0.759–0.769). The highest achieving (neural networks) algorithm predicted 4,998/7,404 cases (sensitivity 67.5%, PPV 18.4%) and 53,458/75,585 non-cases (specificity 70.7%, NPV 95.7%), correctly predicting 355 (+7.6%) more patients who developed cardiovascular disease compared to the established algorithm.

Conclusions
Machine-learning significantly improves accuracy of cardiovascular risk prediction, increasing the number of patients identified who could benefit from preventive treatment, while avoiding unnecessary treatment of others.

Related Stories

Study finds most major heart attacks occur in people with normal cholesterol

April 12, 2017
For decades, national guidelines on which Americans should take cholesterol-lowering medications relied heavily on an individual's level of bad cholesterol (LDL). In 2013, new guidelines moved to treatment based on a person's ...

Younger heart attack patients more likely to have low 'good' vs. high 'bad' cholesterol

March 8, 2017
Men under 45 years old and women under 50 years old who suffer a heart attack are far more likely to have abnormally low good cholesterol than elevated bad cholesterol, according to research scheduled for presentation at ...

Too many Americans have high blood pressure, doctors warn

February 7, 2017
(HealthDay)—A group of family physicians warns that too many Americans struggle with high blood pressure.

A simple blood test could help identify people at risk of a heart attack, a study has found

December 21, 2016
Research shows the troponin test – currently used to help diagnose a heart attack – could be used to assess future heart disease risk.

Young women less likely to be informed of heart disease risk by providers

October 26, 2015
Even when young women had a similar or greater risk for heart disease than young men, they were 11 percent less likely to report that healthcare providers told them they were at-risk for heart disease prior to a heart attack, ...

Low statin use in people with diabetes despite cardioprotective effects, guidelines

September 12, 2016
Nearly 2 out of 5 people with diabetes who could benefit from statin therapy to lower their risk of future heart attack, stroke and related death were not prescribed one, according to a research letter published today in ...

Recommended for you

Hormone therapy in the menopause transition did not increase stroke risk

November 24, 2017
Postmenopausal hormone therapy is not associated with increased risk of stroke, provided that it is started early, according to a report from Karolinska Institutet published in the journal PLOS Medicine.

Low-salt and heart-healthy dash diet as effective as drugs for some adults with high blood pressure

November 22, 2017
A study of more than 400 adults with prehypertension, or stage 1 high blood pressure, found that combining a low-salt diet with the heart-healthy DASH diet substantially lowers systolic blood pressure—the top number in ...

Stroke patients may have more time to get treatment, study finds

November 22, 2017
Patients and doctors long have relied on a simple rule of thumb for seeking care after an ischemic stroke: "Time is brain."

Cases of heart failure continue to rise; poorest people worst affected

November 22, 2017
The number of people being diagnosed with heart failure in the UK continues to rise as a result of demographic changes common to many developed countries, new research by The George Institute for Global Health at the University ...

Some cancer therapies may provide a new way to treat high blood pressure

November 20, 2017
Drugs designed to halt cancer growth may offer a new way to control high blood pressure (hypertension), say Georgetown University Medical Center investigators. The finding could offer a real advance in hypertension treatment ...

Could this protein protect people against coronary artery disease?

November 17, 2017
The buildup of plaque in the heart's arteries is an unfortunate part of aging. But by studying the genetic makeup of people who maintain clear arteries into old age, researchers led by UNC's Jonathan Schisler, PhD, have identified ...

0 comments

Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.