Multiple Medical Teams Use Apple Vision Pro XR Headset During Surgical Procedures, Signaling Emergence of Extended Reality Applications in Healthcare
Technology like Apple’s VR/AR headsets may prove useful to clinical laboratories in accessioning and in pathology labs during biopsy grossing
In what has been billed as a first, medical teams in the US and UK used Apple’s Extended Reality (XR) Vision Pro headset system to assist in surgical procedures. The surgeons themselves did not wear the $3,500 headset. Instead, surgical nurses used the device for touch-free access to a software application that assisted them in setting up, organizing, and performing the operations. For pathologists and clinical laboratories, in the histology laboratory, such an arrangement involving XR headsets could be used when a biopsy is at the grossing station as well.
The headset software the team used during surgery was developed by eXpanded eXistence, Inc. (eXeX), a Florida-based company whose primary product is an iOS (Apple mobile operating system) application that provides similar functions for mobile devices. eXeX adapted the iOS app to work on Apple’s Extended Reality headset.
Extended Reality is an umbrella term for augmented reality (AR) and virtual reality (VR). Apple refers to the technology as “spatial” computing.
Within the clinical laboratory, XR headsets could be used in the accessioning process as the accessioner works through the steps to confirm all required information accompanies the test requisition and that the patient’s specimen is processed/aliquoted appropriately.
“The eXeX platform, enhanced by artificial intelligence, is designed not as a medical device but as an organizational and logistics tool. It aims to streamline the management of tens of thousands of items, including equipment, tools, technologies, consumables, implants, and surgical products,” said neurosurgeon Robert Masson, MD, eXeX’s founder and CEO, in a February news release.
Masson first deployed the software in his own surgical practice. Then in March, eXeX announced that a surgical team at Cromwell Hospital in London used the system in two microsurgical spine procedures, according to a March new release.
That news garnered media coverage in the UK as well as in US-based publications that follow Apple.
Another early user, eXeX announced, was G. Russell Huffman, MD, MPH, of Rothman Orthopaedic Institute. Huffman’s team used the software to perform a reverse total shoulder arthroplasty procedure at the AdventHealth Surgery Center Innovation Tower in Orlando, according to an April news release.
“We are in a new era of surgery, and for the first time, our surgical teams have the brilliance of visual holographic guidance and maps, improving visuospatial and temporal orientation for each surgical team and for each surgery in all specialties,” said neurosurgeon Robert Masson, MD (above), eXeX’s founder and CEO, in a press release. Clinical laboratories may one day use XR headsets in the histology lab at the grossing station. (Photo copyright: Masson Spine Institute.)
Surgical Process Not Glamorous, But Important
Despite being on a cutting-edge XR platform, the eXeX software addresses “the least glamorous part” of the surgical process, Masson told Gizmodo.
“People assume that surgical healthcare has got to be sophisticated and modern,” he said. “The reality is the way we organize it is probably the most archaic of all the major industries on the planet. It’s all memorization and guesswork with scribbles on pieces of paper.”
The advantage of an XR headset is that it allows use of the eXeX software in a sterile environment, he added. “The ability to interact with digital screens and holograms and lists and maps and products unlocks all kinds of possibilities. Suddenly, you’ve got an interactive digital tool that you can use without violating the sanctity of sterility.”
Does he foresee a future when the surgeons themselves use XR headsets in the operating room? Not necessarily, Masson told Gizmodo.
“There’s always a tendency to say, ‘look at this amazing tech, let’s put a screw in with it,’” he said. “Well, we’re already putting screws in without the headset, so it doesn’t really solve a problem. People tend to think of floating spines, floating heights, you know, an overlay that tells you where to put a catheter in the liver. Honestly, it’s all unnecessary because we already do that pretty well. What we don’t do really well is stay organized.”
Other XR Apps for Healthcare
In a news release, Apple showcased other healthcare apps for its Vision Pro platform.
Epic Systems, an electronic health record (EHR) system developer, has an app called Epic Spatial Computing Concept that allows clinicians “to easily complete charting, review labs, communicate using secure chat, and complete in-basket workflows through intuitive gestures, like simply tapping their fingers to select, flicking their wrist to scroll, or using a virtual keyboard or dictation to type,” Apple stated in the news release.
Stryker, manufacturer of Mako surgical robotic arms for joint-replacement procedures, has an Apple iOS app called myMako that “allows surgeons to visualize and review patients’ Mako surgical plans at any time in a brilliant, immersive visual experience,” Apple said.
Boston Children’s Hospital developed an Apple iOS app called CyranoHealth designed to train nurses and other healthcare professionals in how to use new medical technologies, such as infusion pumps.
Cinematic Reality, from Siemens Healthineers, is an Apple iOS app that “allows surgeons, medical students, and patients to view immersive, interactive holograms of the human body captured through medical scans in their real-world environment,” Apple said.
New Era in Technology
For the past 20 years, manufacturing companies have installed systems at workstations with audio and video that show each step in a work process and with written checklists on the computer screen. This allows workers to check off each required step as proof that each required work element was performed.
This is similar to professional pilots who use checklists at every step in a flight process. One pilot will read the checklist items, the other will perform the step and confirm it was complete.
These procedures are generally completed on computer displays, but with the advent of XR headset technology, these types of procedures are evolving toward mobility.
To prepare for the emergence of XR-based healthcare apps, the US Food and Drug Administration (FDA) has organized a research team to devise best practices for testing these headset devices, CNBC reported.
It will be some time before XR headset technology finds its way into histology laboratories, clinical laboratories, and pathology practices, but since the rate of technology adoption accelerates exponentially, it might not take very long.
—Stephen Beale
Related Information:
eXeX and Neurosurgeon Dr. Robert Masson Achieve World First Using Apple Vision Pro
eXeX and Cromwell Hospital Pioneer the First Use of Apple Vision Pro in UK Surgery
Vision Pro Used in Surgery “To Eliminate Human Error”
This Startup Wants to Use the Apple Vision Pro for the Most Boring Part of Surgery
Doctors Are Using the Apple Vision Pro During Surgery
Apple’s Vision Pro Was Used in Surgery to Help Perform Spinal Operations
Apple Vision Pro Unlocks New Opportunities for Health App Developers
