Mining mountains of data for medical insights

June 24, 2014 by Michael Haederle

Epidemiologists know that an important piece of evidence is often staring you in the face – but it's not always easy to see the forest for the trees.

Danish scientists recently teamed up with University of New Mexico researchers to test a powerful new method for predicting the progress of common diseases through time by teasing out previously undetected patterns from a very large data set – in this case, the health records of Denmark's entire population.

This approach maps out surprising correlations: a disease like gout – a form of arthritis – is strongly linked to , for example. In the future, this could enable physicians to make diagnoses sooner using simple tests in combination with known disease progression patterns.

The research is outlined in a study, "Temporal disease trajectories condensed from population-wide registry data covering 6.2 million patients," published Tuesday in Nature Communications.

Pope Moseley, MD, chair of UNM's Department of Internal Medicine and Tudor Oprea, MD, PhD, professor of Internal Medicine and chief of UNM's Translational Informatics Division, collaborated with researchers from the Department of Systems Biology at the Technical University of Denmark, the Novo Nordisk Center for Protein Research at the University of Copenhagen and the Institute of Biological Psychiatry at Copenhagen University Hospital.

"This is a leap into a fairly large data base," Moseley says. "This method is able to recognize patterns in data that not only include diagnostic patterns, but includes the element of time and is able to build networks from that."

Denmark's electronic health registry covers that nation's entire population, with each person assigned a health number, Moseley says. Each medical diagnosis is coded in the registry using the International Classification of Diseases terminology – 101 million unique diagnoses in all.

"Every diagnosis on every Dane from every hospitalization and outpatient clinic visit is entered into the national health registry for the last 14 years," he says. "You're able to take these mass of data and look at it over time and begin to draw associations."

The team boiled down the massive trove of data to 1,171 so-called thoroughfares with central information on the course of diabetes, chronic (COPD), cancer, arthritis and cardiovascular disease.

Lead author Anders Boeck Jensen says this data analysis method made it possible to view diseases in a larger context.

"Instead of looking at each disease in isolation, you can talk about a complex system with many different interacting factors," says Jensen, a post-doctoral fellow at the Center for Protein Research. "By looking at the order in which different diseases appear, you can start to draw patterns and see complex correlations outlining the direction for each individual person."

Oprea points out an additional advantage of the data-mining method. "The disease trajectories in this study follow causal relationships that were identified by a medically agnostic software," he says. "This illustrates the power of data mining as a means to uncover novel disease relationships and its ability to inform the health care sector about new avenues in patient management."

The data analysis showed, for example, that a diagnosis of anemia is typically followed months later by the discovery of colon cancer, Oprea says, "which suggests that cancer lesions were present and occult bleeding occurred, but remained undiagnosed."

Meanwhile, in addition to identifying gout as a step on the path toward cardiovascular disease, the team made surprising findings about COPD.

"In just looking at these codes that were based on age and gender and where the code was done, we were able to say that COPD is diagnosed late," Moseley says. "It's therefore under-diagnosed and probably because of that undertreated. All we have is this diagnostic code, but our analysis of the pattern said that."

That finding received unexpected support last February when another team published a paper on a large epidemiological study of 6,000 Danish COPD patients, each of whom was interviewed and subjected to extensive examination, laboratory review and testing.

"Their conclusion is COPD is diagnosed late, under-diagnosed and undertreated," Moseley says. "We were able to come to the same conclusions without ever having gone the other way. We essentially did the experiment with a computer out of a health registry."

The research could yield tangible health benefits as we move beyond one-size-fits-all medicine, says Prof. Lars Juhl Jensen of the Center for Protein Research.

"The perspective is that your genetic profile or the total network of associated proteins in your body, your proteome, can be mapped in a few years' time, enabling you to suddenly learn things about yourself which can be used to forecast the progress of diseases over an entire lifetime," he says.

Søren Brunak, a professor at the Technical University of Denmark and Center for Protein Research who served as senior author on the paper, adds that the sooner a health risk pattern is identified, "the better we can prevent and treat critical diseases."

Moseley describes the partnership with the Danes as "a really very nice marriage . . . it's a strong informatics and systems biology collaboration." Going forward, he hopes to access the data for even larger populations.

"The author Williams Gibson said something like, 'Everything we need to know about the future is here, now – you just have to be able to recognize the pattern,'" Moseley says. "Never was it more true."

Explore further: Researchers map your route from illness to illness

More information: Nature Communications,

Related Stories

Researchers map your route from illness to illness

June 24, 2014
Researchers from the University of Copenhagen and the Technical University of Denmark have followed six million Danes for 15 years through patient and disease registers. Studies in the complex data landscape now enable researchers ...

First clinical diabetes registry to provide seamless view of patients across specialties

June 10, 2014
The American College of Cardiology, in partnership with the American Diabetes Association, the American College of Physicians and Joslin Diabetes Center, is launching the Diabetes Collaborative Registry, the first clinical ...

Identifying correlations in electronic patient records

August 25, 2011
A new study demonstrates how text mining of electronic health records can be used to create medical term profiles of patients, which can be used both to identify co-occurrence of diseases and to cluster patients into groups ...

COPD patients at significantly higher risk of heart failure

May 18, 2014
As if increased risks of high blood pressure, respiratory infections, lung cancer and even depression weren't enough, researchers say patients with chronic obstructive pulmonary disease (COPD) have another complication to ...

UK study finds doctors are missing chances to diagnose COPD earlier

February 12, 2014
A retrospective study of almost 39,000 patients shows that opportunities to diagnose chronic obstructive pulmonary disease (COPD) at an earlier stage are frequently being missed in both primary and secondary care in the UK. ...

Study shows COPD is not independent risk factor for lung cancer

December 15, 2012
Chronic obstructive pulmonary disease (COPD) and lung cancer are two of the most important smoking-related diseases worldwide, with a huge combined mortality bur¬den. Many consider the presence of COPD itself to be an independent ...

Recommended for you

Want to win at sports? Take a cue from these mighty mice

July 20, 2017
As student athletes hit training fields this summer to gain the competitive edge, a new study shows how the experiences of a tiny mouse can put them on the path to winning.

'Smart' robot technology could give stroke rehab a boost

July 19, 2017
Scientists say they have developed a "smart" robotic harness that might make it easier for people to learn to walk again after a stroke or spinal cord injury.

Engineered liver tissue expands after transplant

July 19, 2017
Many diseases, including cirrhosis and hepatitis, can lead to liver failure. More than 17,000 Americans suffering from these diseases are now waiting for liver transplants, but significantly fewer livers are available.

Lunatic Fringe gene plays key role in the renewable brain

July 19, 2017
The discovery that the brain can generate new cells - about 700 new neurons each day - has triggered investigations to uncover how this process is regulated. Researchers at Baylor College of Medicine and Jan and Dan Duncan ...

New animal models for hepatitis C could pave the way for a vaccine

July 19, 2017
They say that an ounce of prevention is worth a pound of cure. In the case of hepatitis C—a disease that affects nearly 71 million people worldwide, causing cirrhosis and liver cancer if left untreated—it might be worth ...

Omega-3 fatty acids fight inflammation via cannabinoids

July 18, 2017
Chemical compounds called cannabinoids are found in marijuana and also are produced naturally in the body from omega-3 fatty acids. A well-known cannabinoid in marijuana, tetrahydrocannabinol, is responsible for some of its ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.