Researchers use augmented reality to create telementoring system

A research team has created a telementoring system that lets physicians who are in remote areas connect with more experienced doctors and help perform complicated procedures.

Researchers with Purdue University in Lafayette, Indiana, have developed a technique that uses augmented reality (AR) tools to connect doctors with others from around the world. It was designed to help less-experienced doctors who are in war zones, responding to natural disasters or practicing in rural areas.

The system allows a mentee to wear an AR headset in the field and features a transparent headset screen. The headset lets the mentee see the patient in front of them, while that same image is displayed on a video monitor in real time for their mentor in a separate location.

Through the system, the mentor is able to provide real-time, on-screen feedback. The system also uses computer vision algorithms to track and align virtual notes and marks.

“Even without having highly experienced medical leaders physically co-located in the field, with this technology we can help minimize the number of casualties while maximizing treatment at the point of injury,” project team leader Juan Wachs said in a statement.

Since being developed, the system has gone through one round of clinical evaluation and is expected to go through another. It will also be tested during a simulated battlefield experiment at a Navy base in Virginia.

“Our technology allows trainees to remain focused on the surgical procedure and reduces the potential for errors during surgery,” project member Edgar Rojas Muñoz said in a statement.

Video of the AR telementoring system is available here.

""

Danielle covers Clinical Innovation & Technology as a senior news writer for TriMed Media. Previously, she worked as a news reporter in northeast Missouri and earned a journalism degree from the University of Illinois at Urbana-Champaign. She's also a huge fan of the Chicago Cubs, Bears and Bulls. 

Around the web

Compensation for heart specialists continues to climb. What does this say about cardiology as a whole? Could private equity's rising influence bring about change? We spoke to MedAxiom CEO Jerry Blackwell, MD, MBA, a veteran cardiologist himself, to learn more.

The American College of Cardiology has shared its perspective on new CMS payment policies, highlighting revenue concerns while providing key details for cardiologists and other cardiology professionals. 

As debate simmers over how best to regulate AI, experts continue to offer guidance on where to start, how to proceed and what to emphasize. A new resource models its recommendations on what its authors call the “SETO Loop.”