Exploring Applications of Augmented and Mixed Reality in Healthcare

What Is AR/MR?

AR/MR overlays digital content — including images, videos, or 3D models — onto the real world, enhancing the user's perception and interaction with their surroundings, explained Nick Cherukuri, co-founder of ThirdEye, in an interview with LifeSciencesIntelligence. This technology has the potential to redefine healthcare by providing new approaches to visualize and interact with medical data and patients.

How Is AR/MR Used in Healthcare?

According to a report from Kalorama Information, AR/MR technologies, such as smart glasses and virtual headsets, have been widely adopted in the healthcare industry to improve patient outcomes. In the healthcare sector, these technologies are used in various applications, such as telehealth, surgical and medical training, patient education, and rehabilitation.

“Smart glasses aren’t just a research and development tool,” highlighted Cherukuri. “When the X2 MR Glasses were released in 2020, they helped first responders provide effective care during the pandemic.”

Benefits of AR/MR in Healthcare

Various applications of AR/MR technology in healthcare demonstrate its potential to improve patient outcomes, increase medical knowledge and skill, and enhance the overall quality of patient care, said Cherukuri.

AR/MR-based technology can provide medical professionals with improved visualization and accuracy of patient anatomy, making it easier to plan and deliver care. Patients can also benefit from AR/MR by simulating 3D models of their anatomy or medical devices, which can help them better manage their medical conditions.

“When wearing the X2 MR glasses, people can improve their vision by zooming in and out. They can also do optical character recognition and color changes,” emphasized Cherukuri. “For patients with Alzheimer's disease, the glasses can display information next to a person’s or object's face or help with remembering daily tasks.”

Medical students and other healthcare professionals can also benefit from AR/MR technology by experiencing immersive and interactive simulations of complex medical procedures, improving their skills and knowledge.

In a recent study, the use of AR/MR in healthcare education beyond surgery was analyzed using 26 related studies from January 2013 to September 2018. The researchers found that AR/MR technologies were associated with several healthcare educational benefits and outperformed traditional learning approaches in 11 studies.

During surgical planning and guidance, AR/MR technologies provide medical professionals with real-time, accurate, and detailed information about the patient, allowing for more precise and accurate surgeries.

“For example, a remote doctor can see exactly what other healthcare professionals see in real-time when using this technology,” Cherukuri added.

Because only 5–20% of low- and middle-income countries have timely access to safe and affordable surgical procedures, the use of affordable equipment could help practitioners worldwide master surgical procedures that are prohibitively expensive while decentralizing training.

Additionally, AR/MR can be used for rehabilitation to provide patients with visual feedback and motivation during physical therapy.

Drawbacks of AR/MR in Healthcare

While AR/MR has the potential to transform the way healthcare is delivered, there are several perceived drawbacks to its implementation. One of the main concerns is the high cost of the technology, which can be a significant financial burden for hospitals and medical institutions that require many devices.

According to Cherukuri, a pair of the X2 MR/AR Smart glasses cost $2,450.00. “However, bundle or quantity-reduced pricing is available for large orders,” he added.

Another potential drawback is the complexity of the technology, which requires significant technical expertise to operate and maintain. In addition, some patients may find AR/MR technology uncomfortable or intimidating, leading to poor patient experience and lower patient satisfaction.

“This product does not have a long learning curve — nowadays, people are comfortable using the smart glasses within a week or two,” Cherukuri shared. “According to some users, a main advantage of these glasses is that they are all-in-one, standalone — meaning no wires and no need to connect to a phone — devices.”

To streamline implementation and resolve issues quickly, Cherukuri pointed out that ThirdEye offers 24/7 customer support and provides a dedicated support representative to larger organizations.

“Besides the hands-free and wire-free features, the Android-based glasses, hardware, and software are all developed in-house to make it a more powerful all-in-one solution. The inclusion of the Android system also makes it easier for developers to develop applications.”

Even with these added advantages, some worry that using AR/MR could lead to information overload and distraction for medical professionals, increasing the risk of errors during procedures.

The X2 MR glasses can be controlled by head motion movements, similar to a virtual reality device, which some individuals find preferable. Additionally, voice commands are available in over 80 languages, allowing users to access features like opening the camera or making calls easily. For those who prefer a tactile approach, gestures such as pinching in front of the glasses can be used to click or go back.

“Different users prefer different user interfaces. By Incorporating multiple methods of control, users can pick and choose what they prefer,” Cherukuri reassured. “With these diverse control options, users can tailor their experience to best suit their needs.”

For those who find the fit too loose, a head strap is available to provide additional support. Although there may be a few extreme cases where the glasses do not fit, Cherukuri and his team are confident that 99% of users can adjust the glasses to their faces. With this versatile solution, smart glasses offer a comfortable and customizable experience for all.

Future Developments

Future developments and updates to AR/MR devices have the potential to significantly advance healthcare by enhancing the capabilities and functionality of the technology. For example, device improvements could provide medical professionals with even more detailed and accurate patient information, significantly improving patient care, medical education and training, and collaboration between medical professionals.

“This year, the upcoming 2023 update will offer advanced features, such as a significantly expanded field of view and enhanced 3D tracking capabilities.”

Moreover, developing affordable AR/MR devices could increase access to these technologies for healthcare providers and patients, particularly in low- and middle-income countries.