Opinion: Want less bias in medical AI? Let patients help train models

Healthcare AI has potential not only for neutralizing its inherent algorithmic bias but also for personalizing its outputs to help humans address health inequities.

All it will take is incorporating an ingredient missing from most algorithm training: patient input.

In fact, early testing of this hypothesis has already demonstrated the feasibility of patient-inclusive AI development.

Specifically, some of this research “has produced an algorithm trained to predict the knee pain reported by the patient, rather than the X-ray interpretation of the doctor,” the authors of a May 29 Lancet opinion piece write.

“This approach explained more of all patients’ pain compared with standard measures of radiographic severity,” they report, “and its explanatory power for pain was particularly useful for underserved groups of patients, such as Black patients or patients with low income and low education.”

The authors are Ziad Obermeyer, MD, of UC-Berkeley and the renowned book author and healthcare influencer Eric Topol, MD, of Scripps Research.

To the observation above they add that, compared with conventional means of understanding patients’ pain levels, the experimental algorithm outdid radiologists at this aim largely because its training included severity scores self-reported by a racially and ethnically diverse population.

The authors of the study under discussion, whose number included Obermeyer, further found that incorporating the algorithm’s patient-centric severity score while leaving out the radiologist’s pain prediction doubled the proportion of Black patients’ knees that were deemed eligible for replacement.

If replicable, Obermeyer and Topol suggest, the patient-inclusive AI training methodology might not only widen access to knee replacement surgeries but also help advance “a new kind of clinical science.”

For example, by grounding patient reports of pain in objective radiographic features, we might develop a more comprehensive understanding of what causes pain. By not being doctor-centric and incorporating the patient's perspective, machine learning has added potential for unravelling important mysteries of medicine.

Access the piece here.

Dave Pearson

Dave P. has worked in journalism, marketing and public relations for more than 30 years, frequently concentrating on hospitals, healthcare technology and Catholic communications. He has also specialized in fundraising communications, ghostwriting for CEOs of local, national and global charities, nonprofits and foundations.

Around the web

The tirzepatide shortage that first began in 2022 has been resolved. Drug companies distributing compounded versions of the popular drug now have two to three more months to distribute their remaining supply.

The 24 members of the House Task Force on AI—12 reps from each party—have posted a 253-page report detailing their bipartisan vision for encouraging innovation while minimizing risks. 

Merck sent Hansoh Pharma, a Chinese biopharmaceutical company, an upfront payment of $112 million to license a new investigational GLP-1 receptor agonist. There could be many more payments to come if certain milestones are met.