When AI impedes care | Partner voice | UnitedHealth hearts AI, agentic AI again, healthcare AI dependency, more

News You Need to Know Today
View Message in Browser

When AI impedes care | Partner voice | UnitedHealth hearts AI, agentic AI again, healthcare AI dependency, more

Tuesday, May 6, 2025
Link to Twitter Link to Facebook Link to Linkedin Link to Vimeo

Nabla Logo ●  Fellow

Artificial Intelligence AI in healthcare

First, do no AI: How not to help the world’s struggling healthcare systems

An international team of researchers is calling on healthcare AI proponents to be more mindful of the technology’s unsuitability across much of the developing world. 

It’s not that resource-starved clinics, hospitals and clinics wouldn’t like to adopt AI and other emerging technologies to improve care, streamline workflows and optimize administration. It’s that they would first need help solving much more basic problems.  

“Like previous medical technologies, AI tools risk reinforcing existing patterns of technological dependency if implemented without addressing fundamental health system requirements,” write senior researcher Amelia Fiske, PhD, of the Technical University of Munich and colleagues, in a paper published May 2 in BMC Global and Public Health. “[W]ho benefits from pushing an AI-first narrative for healthcare, and does this paradigm truly serve the interests of the most disadvantaged patients?”

To flesh out their proposal for a technology-can-wait response to global medical need, the authors take their cue from the late Paul Farmer, MD, PhD (1959-2022). Farmer was an infectious disease specialist, medical anthropologist and humanitarian who worked tirelessly in Africa and Haiti. Fiske and co-authors apply his “5S” framework for healthcare-based poverty relief to current concerns around AI and global health. 

1. STAFF: Healthcare workers must be supported before AI can be considered.

When considering AI implementation, healthcare systems “must demonstrate their ability to recruit, develop, retain and support human healthcare workers,” Fiske and colleagues write. “Systems struggling with basic staffing should prioritize workforce development over AI investment.” More: 

‘Only with a well-prepared, appropriately supported workforce can healthcare systems create conditions where AI tools might eventually enhance rather than undermine care delivery.’

2. STUFF: Basic resources and infrastructure must precede technological investment. 

Discussions of AI in healthcare often focus on sophisticated computational infrastructure, the authors note. This approach, they maintain, misses a crucial point: “[Many healthcare systems still struggle to maintain reliable access to basic medicines, supplies and equipment.”

‘This reality demands we reconsider the relative priority of AI investment against fundamental material needs.’

3. SPACES: Physical healthcare infrastructure cannot be leapfrogged by digital solutions.

AI enthusiasts sometimes suggest that digital health can transcend physical barriers to access. But those who proceed from such idealism tend to overlook “a fundamental reality: The vast majority of healthcare interventions—from preventive care to emergency services—require physical spaces for delivery.”

‘Digital spaces must be understood as extensions of, not replacements for, physical healthcare infrastructure.

4. SYSTEMS: Strong healthcare governance has to come before innovative technological improvement. 

Local healthcare workers and communities “understand the systemic constraints and opportunities within their contexts in ways that external actors cannot,” the authors point out. 

‘A systems perspective demands an honest assessment of trade-offs: How do potential AI implementation costs compare to investments in basic healthcare infrastructure, essential medicines or workforce development?’

5. SUPPORT: Social infrastructure determines healthcare success more than technology.

“Consider an AI system designed to optimize medication adherence,” Fiske et al. urge. “Even if technically perfect, it cannot succeed where patients cannot afford prescribed medications, lack reliable transportation to pharmacies or work multiple jobs that make regular medication schedules impossible.”

‘The technology-first mindset fundamentally misunderstands how social conditions determine healthcare outcomes.’

As Paul Farmer’s work consistently demonstrated, the authors conclude, meaningful improvements in health outcomes “require political commitment and sustained investment in basic healthcare infrastructure.”

“Until healthcare systems can demonstrate sustainable capabilities across all dimensions of the 5S framework,” they add, “AI implementation runs the risk of not just being premature but potentially harmful.”

‘The measure of success in healthcare should not be the sophistication of our technology but the consistent delivery of quality care to all who need it.’

The paper is posted in full for free

 

 Share on Facebook Share on Linkedin Send in Mail

The Latest from our Partners

Nabla's ambient AI assistant is helping Tia set a new benchmark in women’s healthcare.
With faster note-taking and stronger patient-provider connections, Tia clinicians are reclaiming time and deepening care.
Read the case study and hear what clinicians have to say: https://www.nabla.com/case-studies/tia-health

 Share on Facebook Share on Linkedin Send in Mail
artificial intelligence AI in healthcare

Healthcare AI newswatch: UnitedHealth hearts AI, agentic AI again, healthcare AI dependency, more

Buzzworthy developments of the past few days.

  • UnitedHealth Group is all about AI. Still. One might read the perseverance as a sign of defiance, given the insurance giant’s fight against a class action lawsuit over AI-aided claims denials. But that doesn’t seem to be it, according to a May 5 Wall Street Journal article. The reporter found UnitedHealth now has around 1,000 applications up and running. And an eye-opening 20,000 of its engineers are using the technology to write software. CTO Sandeep Dadlani tells the newspaper AI “has a role to play” in the claims evaluation process, but that’s a small slice of AI’s deployment across UHC. Dadlani says the company wants to eventually market some of its AI innovations to other healthcare companies but is in no rush to do so. “AI is the most exciting technology,” Dadlani tells the WSJ. “But my job is to help really be practical and pragmatic, ambitious and yet very responsible with this.”
     
  • Lacking a healthcare-specific problem to solve, healthcare AI is just cool math. That’s the perspective of the CEO and COO of the Parkland Center for Clinical Innovation in Texas. “As leaders in AI applications for clinical decision support and population health, we continually encounter new challenges,” write the execs, Steve Miff and Aida Somun. “[H]owever, we remain confronted by our most enduring issues—patient access challenges and resource capacity.” They make a strong case for healthcare AI’s success hinging on trustworthiness, which they state isn’t achievable without transparency. Hear them out in D magazine. (That’s D as in Dallas).
     
  • We keep hearing that self-running algorithmic agents will be the next big thing in AI. So what are they going to do in healthcare? Newsweek sent a reporter to ask that question of a handful of experts. The way some talk about these digital agents, the darn things may as well punch timeclocks and take breaks. “I’m hopeful that my team of care coordinators and AI agents can work together,” says one professional. The human-machine collaboration will help “make sure the patient actually gets everything they need done at the appointment, their population health is taken care of [and] their family dynamics are considered.” Read the rest
     
  • The World Health Organization wants to establish unified standards for AI in healthcare via the United Nations. In a paper published April 23 in NPJ Digital Medicine, WHO-affiliated researchers break the organization’s proposal into four sets of priorities—ethics, regulation, implementation and operations. These separate but overlapping spheres of attention are “foundational in the advancement of equitable, safe and effective AI for the global community,” the authors write. The organization’s Global Initiative on Artificial Intelligence for Health—GI-AI4H—“builds on global momentum to establish health AI governance [guidelines] that are durable and balanced in their approach, unifying and strengthening diverse capabilities across member states.” That’s a bare summary. If interested in the WHO’s thinking on globally sharable AI standards, read the whole thing
     
  • IT workers are always in high demand. That doesn’t mean they’re not just as worried as the rest of us about AI taking their jobs. Computerworld considers the proper care and feeding of these essential but professionals who are understandably uneasy of late. One IT leader, Daniela LaCelle of the employee-benefits company Unum, says encouraging staff to view AI as an enabler rather than a threat “shifts the focus toward opportunities rather than fears.” The aim is allowing IT teams to think in terms of strategy and creativity, which “encourages greater engagement while easing employees’ fears about job security.” 
     
  • Give healthcare workers AI to do their jobs and you might make them AI-dependent. Casey Greene, PhD, a biomedical informatics professor at the University of Colorado School of Medicine acknowledges the challenge in a conversation with the school’s own news operation. Asked how to present AI as a tool while keeping it from becoming a crutch, Greene says remaining mindful of the risk is “absolutely vital. We want to reduce friction but not critical thinking.” There are areas where humans excel, he says before adding: “We want to ensure we’re supporting that and not replacing it.” Q&A here
     
  • AI is one of the more exciting sister technologies to mind-meld with surgical robotics. It’s also one of the more apt to complexify things. In MD+DI, Tarken Friske, senior director of consulting with the software developer Full Spectrum, offers suggestions to robotics leaders for producing multifaceted, multi-technology surgical systems so they can bring these products to market sooner rather than later. His top three: integrate early and often, revisit risk management and emphasize verification planning. “While applying these concepts cannot eliminate all potential for program delays,” he writes, it can “drastically improve the observability of development progress and give development teams more opportunities to influence positive outcomes.”
     
  • Recent research in the news: 
     
  • Regulatory approvals & certifications:
     
  • M&A activity:
     
  • Funding news of note:
     
  • From AIin.Healthcare’s news partners:
     

 

 Share on Facebook Share on Linkedin Send in Mail

Innovate Healthcare thanks our partners for supporting our newsletters.
Sponsorship has no influence on editorial content.

Interested in reaching our audiences, contact our team

*|LIST:ADDRESSLINE|*

You received this email because you signed up for newsletters from Innovate Healthcare.
Change your preferences or unsubscribe here

Contact Us  |  Unsubscribe from all  |  Privacy Policy

© Innovate Healthcare, a TriMed Media brand
Innovate Healthcare