Expert discusses augmented intelligence in healthcare

April 17, 2018, Public Library of Science
Expert discusses augmented intelligence in healthcare
Credit: National Cancer Institute

The potential of using machine learning techniques in medicine is immense. As electronic health records have become widely available, there is hope that machine learning will improve diagnosis and care. However, integrating these new methodologies into medical practice is challenging. New methods need to meet healthcare standards, for example around doctor accountability and patient privacy, and must be smoothly integrated into clinical decision-making practices.

We had the pleasure of speaking to Arthur Papier who has been working on problems like these for decades. A dermatologist by training, he started working with in the 1980s and launched a clinical decision support tool called VisualDX at the turn of the millennium. VisualDX aids physicians in exploring all diagnostic possibilities through visual clues. The tool combines a search through a database of which symptoms and findings convey which diagnoses with images of how the disease in question looks on skin, eyes, mouth and in radiography.

Arthur Papier will be speaking about his experiences with clinical decision support systems and about the opportunities and challenges of machine learning in healthcare at the Human Intelligence & Artificial Intelligence in Medicine Symposium in Stanford on 17 April. Registration for the event is still open.

PLOS ONE, in collaboration with PLOS Medicine and PLOS Computational Biology, is currently calling for papers in Machine Learning for Health and Biomedicine.

Interview with Arthur Papier

How did you come to work on clinical decision support systems?

I had the great fortune to work with Lawrence Weed, the physician who invented a problem-oriented system to record patient information called SOAP notes, in the 1980s. Dr. Weed had realized in the 1960s that patient records were not only illegible but that there was also a lack of organisation which impeded clear thinking. With Dr. Weed, I worked on software as a strategy to standardize the way histories and information from patients are gathered. I then went to Rochester, New York, the home of Kodak, which had invented the first digital cameras. This presented an opportunity to combine the ideas of Dr. Weed with concepts of visualization of medical information. We started developing prototypes of our clinical decision support systems pre-internet, in the 1990s. In 1999, when the Internet had been born, we started VisualDX as a company and launched the first product in March 2001, right at the dawn of digital information use.

Our core mission is to improve point of care decisions. Our company focusses on the idea that you can't memorize it all. Rather, you need to develop that standardize knowledge to support physicians.

In view of emerging machine-learning technologies for clinical applications, how do you think clinical decision support systems will improve over the next decade?

Machine learning is incredibly exciting, there is a tsunami of interest worldwide. I think that machine learning is going to keep advancing with more and better data. But the crucial question is what you use those machine-learning methods for. In healthcare there are fundamentals to the way patients are assessed. This process doesn't follow strict laws like Newtonian physics. Rather, information systems must account for greyness and ambiguity. We think that, while machine learning is going to augment what we do and will improve specific tasks, it will not take over medical thinking and medical problem solving completely.

For VisualDX, we have focussed on using machine learning methods to solve very specific problems, for example that non-dermatologists don't have the same visual knowledge as dermatologists. This implies that they are unable to describe a rash as well as dermatologists can. We have trained our machine-learning method to augment the ability of general practitioners to describe the features of a rash and identify diagnostic possibilities. The machine learning method doesn't go right to the diagnosis but rather aids doctors to organise their thinking around possibilities.

Machine learning methods will get better and better, but they need to plug into a way of thinking, an existing structure. In our view, machine learning is about augmenting intelligence rather than . It's going to make us sharper and become a window into things that we couldn't see before but it's going to be part of a system of care and a system of thinking.

What are the biggest challenges for using machine-learning assisted tools in a clinical setting?

Apart from the technical challenges, there are cultural and legal and societal challenges. How do clinicians and patients interact with the tool, in particular when it comes to legal questions of responsibility? If you have a system with a powerful machine learning technique that goes straight to a diagnosis and the doctor cannot check it, is the manufacturer of the machine then legally liable when a mistake happens? For those sorts of societal questions, we are far from understanding how we're going to handle them. There is also the issue of de-skilling people. When people over rely on , they lose skills. In our work, we're trying to use machine learning methods to get a teaching and training effect rather than deskilling people.

How could collaboration between machine learning researchers and clinicians and clinical researchers be improved?

What I've learned from working with engineers over many years is that there is a huge difference in thinking between doctors and engineers. Engineers always look for very discrete answers. But a typical thing for a doctor to say is: "I don't know yet, the answer is going to fall out over time. It's ambiguous, it's grey." If engineers are going to be successful in healthcare, I recommend that they work with physicians to understand how we solve problems and how difficult it can be to make decisions with the limited data we have.

For many applications in healthcare, including decision support systems, availability of data is very important. What do you think are the most promising approaches for reconciling with data sharing?

We must be completely transparent with patients and obtain informed consent about use of their data for research. If you explain to patients how you're going to use their data, most patients will want to participate to improve care. It's very important for healthcare systems to engage patients in that conversation. A positive development in this regard are apps, for example an app that Apple is offering, which allow patients to load their medical data directly from the hospital servers into their phone. The tech company is not in the middle and the health information doesn't go through their servers. The patients then have complete control over who they give permission to use their data. These examples are promising but it takes commitment to privacy. Leading tech companies will have to be committed to privacy to make research possible.

How can we give patients a role in the discussion about the ethics and implications of automated clinical decisions, use of data and artificial intelligence in medicine?

I think that this discussion will need to involve physicians and their patients alike. Academic centres are going to lead the way in involving physicians and in setting standards on how to be transparent with . The discussion is going to take time but with the right leadership in the academic centres and the tech companies we'll get there.

Explore further: Machine learning techniques show promise for supporting medical decisions

Related Stories

Machine learning techniques show promise for supporting medical decisions

February 28, 2018
Several studies being presented at the American College of Cardiology's 67th Annual Scientific Session demonstrate how the computer science technique known as machine learning can be used to accurately predict clinical outcomes ...

Researchers say use of artificial intelligence in medicine raises ethical questions

March 15, 2018
In a perspective piece, Stanford researchers discuss the ethical implications of using machine-learning tools in making health care decisions for patients.

Teaching machines to spot essential information in physical systems

March 29, 2018
Two physicists at ETH Zurich and the Hebrew University of Jerusalem have developed a novel machine-learning algorithm that analyses large data sets describing a physical system and extract from them the essential information ...

Will a machine pick your next medication?

February 16, 2018
What once seemed like a scene from a 22nd century sci-fi movie is reality today. High speed, big data-processing computers combine artificial intelligence with human know-how to crack complex health care conditions. This ...

New AI method keeps data private

December 20, 2017
Modern AI is based on machine learning which creates models by learning from data. Data used in many applications such as health and human behaviour is private and needs protection. New privacy-aware machine learning methods ...

Machine learning identifies breast lesions likely to become cancer

October 17, 2017
A machine learning tool can help identify which high-risk breast lesions are likely to become cancerous, according to a new study appearing online in the journal Radiology. Researchers said the technology has the potential ...

Recommended for you

Teens get more sleep with later school start time, researchers find

December 12, 2018
When Seattle Public Schools announced that it would reorganize school start times across the district for the fall of 2016, the massive undertaking took more than a year to deploy. Elementary schools started earlier, while ...

Large restaurant portions a global problem, study finds

December 12, 2018
A new multi-country study finds that large, high-calorie portion sizes in fast food and full service restaurants is not a problem unique to the United States. An international team of researchers found that 94 percent of ...

Receiving genetic information can change risk

December 11, 2018
Millions of people in the United States alone have submitted their DNA for analysis and received information that not only predicts their risk for disease but, it turns out, in some cases might also have influenced that risk, ...

Yes please to yoghurt and cheese: The new improved Mediterranean diet

December 11, 2018
Thousands of Australians can take heart as new research from the University of South Australia shows a dairy-enhanced Mediterranean diet will significantly increase health outcomes for those at risk of cardiovascular disease ...

Effect of oral alfacalcidol on clinical outcomes in patients without secondary hyperparathyroidism

December 11, 2018
Treatment with active vitamin D did not decrease cardiovascular events in kidney patients undergoing hemodialysis, according to a research group in Japan. They have reported their research results in the December 11 issue ...

Licence to Swill: James Bond's drinking over six decades

December 10, 2018
He may be licensed to kill but fictional British secret service agent James Bond has a severe alcohol use disorder, according to an analysis of his drinking behaviour published in the Medical Journal of Australia's Christmas ...


Please sign in to add a comment. Registration is free, and takes less than a minute. Read more

Click here to reset your password.
Sign in to get notified via email when new comments are made.