This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:


peer-reviewed publication

trusted source


AI must not worsen health inequalities for ethnic minority populations, say epidemiologists

big data
Credit: CC0 Public Domain

Scientists are urging caution before artificial intelligence (AI) models such as ChatGPT are used in health care for ethnic minority populations. Writing in the Journal of the Royal Society of Medicine, epidemiologists at the University of Leicester and University of Cambridge say that existing inequalities for ethnic minorities may become more entrenched due to systemic biases in the data used by health care AI tools.

AI models must be "trained" using data scraped from different sources such as health care websites and . However, evidence shows that ethnicity data are often missing from health care research. Ethnic minorities are also less represented in research trials.

Mohammad Ali, Ph.D. Fellow in Epidemiology at the College of Life Sciences, University of Leicester, says, "This disproportionately lower representation of ethnic minorities in research has evidence of causing harm, for example by creating ineffective drug treatments or treatment guidelines which could be regarded as racist. If the published literature already contains biases and less precision, it is logical that future AI models will maintain and further exacerbate them."

The researchers are also concerned that health inequalities could worsen in low- and (LMICs). AI models are primarily developed in wealthier nations like the U.S. and Europe, and a significant disparity in research and development exists between high- and low-income countries.

The researchers point out that most published research does not prioritize the needs of those in the LMICs with their unique health challenges, particularly around health care provision. AI models, they say, may provide advised based on data on populations wholly different from those in LMICs.

While crucial to acknowledge these potential difficulties, say the researchers, it is equally important to focus on solutions. "We must exercise caution, acknowledging we cannot and should not stem the flow of progress," says Ali.

The researchers suggest ways to overcome potentially exacerbating health inequalities, starting with the need for AI models to clearly describe the data used in their development. They also say work is needed to address ethnic in research, including improving recruitment and recording of ethnicity information. Data used to train AI models should be adequately representative, with key actors such as ethnicity, age, sex and socioeconomic factors considered. Further research is also required to understand the use of AI models in the context of ethnically diverse populations.

By addressing these considerations, say the researchers, the power of AI models can be harnessed to drive positive change in health care while promoting fairness and inclusivity.

More information: Addressing ethnic and global health inequalities in the era of artificial intelligence healthcare models: a call for responsible implementation, Journal of the Royal Society of Medicine (2023). DOI: 10.1177/01410768231187734

Provided by SAGE Publications
Citation: AI must not worsen health inequalities for ethnic minority populations, say epidemiologists (2023, July 19) retrieved 4 December 2023 from
This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

Explore further

UK's NHS 'flying blind' in attempt to tackle ethnic inequalities in care, warns expert


Feedback to editors