Article

Scientific letter

REC Interv Cardiol. 2022;4:333-342

Use of extended realities in interventional cardiology: mixed reality for TAVI procedure

Aplicaciones de las realidades extendidas en cardiología intervencionista: la realidad mixta aplicada al procedimiento TAVI

Alfredo Redondoa,b, Carlos Baldróna,c, Javier M. Aguiard, José Ramón González Juanateyb,c, Alberto San Román,a,c and Ignacio J. Amat-Santosa,c,

aServicio de Cardiología, Hospital Clínico Universitario de Valladolid, Valladolid, Spain

bServicio de Cardiología, Complexo Hospitalario Universitario de Santiago de Compostela, Santiago de Compostela, A Coruña, Spain

cCentro de Investigación Biomédica en Red de Enfermedades Cardiovasculares (CIBERCV), Spain

dEscuela Técnica Superior de Ingenieros de Telecomunicación, Universidad de Valladolid, Valladolid, Spain

Twitter Autor: ignamatsant

To the Editor,

A novel aspect of medical imaging visualization are the so-called extended realities, a term that includes a plethora of very different technologies such as virtual, augmented, and mixed reality. The latter being the most recent one of all. The ultimate feature of mixed reality headsets is their capacity to perceive the real world while mixing virtual models to complement the sources of information traditionally available. In principle, there are multiple possible applications to the medical field being particularly interesting their integration into surgical and interventional procedures. Currently, the main limitation preventing their clinical applicability is that no commercial applications remain available in the market for users. Also that, for every specific new case, specific solutions need to be developed.

In the context of the «3D Augmented Reality Cath Lab» research project (the HAMMOND project) only 1 preliminary clinical experience integrating the mixed reality HoloLens 2 headset (Microsoft, United States) has taken place (figure 1) in the percutaneous coronary intervention setting. Prior to the research ethics committee approval (CASVE-PI-GR-20-2001) a mixed reality application was developed for cardiac catheterization care that was tried in 9 patients treated with transcatheter aortic valve implantation (TAVI).


Figure 1. HoloLens extended mixed reality headset 2.


The descriptive results of this early experience with mixed reality in the different stages of TAVI procedures—shown on figure 1 and video 1 of the supplementary data—follow next:

  • – Vascular puncture guidance support: holograms with echocardiogram imaging were generated in real time (figure 2A). Therefore, through the creation of large virtual «screens» with better ergonomics the operator can visualize both his hands and the imaging support simultaneously. The fine resolution and little latency of the system used allowed us to gain ultrasound-guided arterial access as seen on the HoloLens 2 headset in 5 consecutive cases. Room for improvement has been identified and is in the pipeline right now: the integration of the ultrasound image acquired with the ultrasound probe in such a way that the holograms would be visualized in the «real» position towards the inside of the patient (figure 2B). Currently, several early experiences have been reported with this type of integration1 like hologram-guided punctures mixed with computed tomography (CT) images. The use of holograms from CT generated organs overlapping the patient’s real anatomy has been reported allowing us to simplify complex vascular procedures.2
  • – Interaction with CT generated images in conditions of asepsis: the capacity of augmented reality headsets to be used via voice commands or the user’s own hands (as seen on video 1 of the supplementary data) allows the operator to check different sources of information without losing sterility or interfering with the procedure. Figure 2C and video 1 of the supplementary data exemplify this application with the intraoperative examination of the patient’s CT scan of using the 3mensio Structural Heart software (Pie medical imaging, The Netherlands).
  • – Remote procedural supervision: remote mentoring has proven an extremely useful imaging modality during the COVID-19 pandemic.3,4 In our own single experience with 9 cases including 4 transcatheter aortic valve implantation procedures, 3 bicaval valve implantation procedures for tricuspid regurgitation, and 2 chronic total coronary occlusions, the images and the sound captured by the HoloLens 2 headset can be remotely transmitted to the expert in real time. Therefore, he can not only see the x-ray and the ultrasound images as it is the case with conventional remote mentoring (teleconference), but also the operator’s point of view. Also, the mentor can control the information available through the virtual windows that the operator can see life, for instance, the CT working station. Alternatively, different solutions of telepresence and remote communication have become available like the Mesh software (Microsoft, United States) that allow the operator to visualize the mentor as a real-time hologram (figure 2D).

Figure 2. A: vascular ultrasound integration during puncture. B: schematic representation of simultaneous integration in vascular puncture.1 C: image from the software analysis of the manageable computed tomography scan in conditions of asepsis; D: remote mentoring simulation.


Mixed reality-based technology is giving its first early steps regarding surgical and interventional procedures. Our early experience shows—using scientific methodology—the current actual clinical experience applied to TAVI procedures beyond the future potential benefits of this technology.

The limitations identified when implementing this technology in the interventional cardiology field are basically the complexity associated with the process of integrating hologram-like real-time ultrasound images into the patient’s anatomical structures. Improving this aspect requires better software (by developing applications specifically designed for the use this technology in the interventional cardiology field) and hardware (to facilitate the spatial location of both holograms and patients).

In conclusion, mixed reality can improve the integration of different imaging modalities while performing cardiovascular procedures on our patients. Also, it allows the operator to focus on a single working site, which has the potential of improving the patient’s safety parameters. Thanks to these advantages and the fact that technology has finally reached its maturity at an affordable cost, the continuity of this line of work could be crucial to push interventional cardiology into the future.

FUNDING

The HAMMOND project received a grant from Castille and León Regional Health Authority (GRS 2275/A/2020), and Instituto de Salud Carlos III (DTS21/00158).

AUTHORS’ CONTRIBUTIONS

A. Redondo, and I.J. Amat-Santos contributed substantially to the study design, data curation, analysis or interpretation. C. Baldrón, and J.M. Aguiar contributed to the study design, data curation and interpretation. J.R. González Juanatey, and A. San Román gave their final approval. All the authors performed a critical review of the manuscript intellectual content, and take full responsibility for the accuracy and truthfulness of the study.

CONFLICTS OF INTEREST

None whatsoever.

SUPPLEMENTARY DATA



Vídeo 1. Amat-Santos IJ. DOI: 10.24875/RECICE.M22000322

REFERENCES

1. Nguyen T, Plishker W, Matisoff A, Sharma K, Shekhar R. HoloUS: Augmented reality visualization of live ultrasound images using HoloLens for ultrasound-guided procedures. Int J Comput Assist Radiol Surg. 2022;
17:385-391.

2. Pratt P, Ives M, Lawton G, et al. Through the HoloLens™ looking glass: augmented reality for extremity reconstruction surgery using 3D vascular models with perforating vessels. Eur Radiol Exp. 2018;2:2.

3. Arslan F, Gerckens U. Virtual support for remote proctoring in TAVR during COVID-19. Catheter Cardiovasc Interv. 2021;98:E733-E736.

4. Mahajan AP, Inniss DA, Benedict MD, et al. International Mixed Reality Immersive Experience: Approach via Surgical Grand Rounds. J Am Coll Surg. 2022;234:25-31.

* Corresponding author.

E-mail address: ijamat@gmail.com (I.J. Amat Santos).

  @ignamatsant

Editor's page

Recic 22 422 F1

Original articles

Recic 22 013 Fig1

Editorials

Original articles

Recic Uk 22 005 F1
Recic 22 012 Fig2

Special articles

Recic 21 093 F2

Original articles

Review Articles

Recic 22 038 F2

Editorials


Review Articles

Recic 22 040 F2

Debate

A debate: Estrategias de revascularización percutánea para la enfermedad del tronco común distal

Recic 22 062 F1
Recic 22 071 G001

Percutaneous closure of fistula between pulmonary trunk and Fontan circulation

José Miguel Blanco Borreguero, Inmaculada Guillén Rodríguez, et al.

How would I approach it?
Pedro Betrián Blasco

Case resolution
José Miguel Blanco Borreguero, Inmaculada Guillén Rodríguez, et al.

Save
Cookies user preferences
We use cookies to ensure you to get the best experience on our website. If you decline the use of cookies, this website may not function as expected.
Accept all
Decline all
Read more
Analytics
Tools used to analyze the data to measure the effectiveness of a website and to understand how it works.
Google Analytics
Accept
Decline