<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1 20151215//EN" "http://jats.nlm.nih.gov/publishing/1.1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" article-type="case-report" dtd-version="1.1">
<front>
<journal-meta>
<journal-id journal-id-type="pmc">CHD</journal-id>
<journal-id journal-id-type="nlm-ta">CHD</journal-id>
<journal-id journal-id-type="publisher-id">CHD</journal-id>
<journal-title-group>
<journal-title>Congenital Heart Disease</journal-title>
</journal-title-group>
<issn pub-type="epub">1747-0803</issn>
<issn pub-type="ppub">1747-079X</issn>
<publisher>
<publisher-name>Tech Science Press</publisher-name>
<publisher-loc>USA</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">19119</article-id>
<article-id pub-id-type="doi">10.32604/chd.2022.019119</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Case Report</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Multimodal Imaging with 3D-Holograms for Preoperative Planning in Pediatric Cardiac Surgery: A Unique Case Report</article-title>
</title-group>
<contrib-group>
<contrib id="author-1" contrib-type="author">
<name name-style="western"><surname>Caldaroni</surname><given-names>Federica</given-names></name>
<xref ref-type="aff" rid="aff-1">1</xref>
</contrib>
<contrib id="author-2" contrib-type="author">
<name name-style="western"><surname>Chessa</surname><given-names>Massimo</given-names></name>
<xref ref-type="aff" rid="aff-2">2</xref>
</contrib>
<contrib id="author-3" contrib-type="author">
<name name-style="western"><surname>Varrica</surname><given-names>Alessandro</given-names></name>
<xref ref-type="aff" rid="aff-1">1</xref>
</contrib>
<contrib id="author-4" contrib-type="author" corresp="yes">
<name name-style="western"><surname>Giamberti</surname><given-names>Alessandro</given-names></name>
<xref ref-type="aff" rid="aff-1">1</xref><email>alessandro.giamberti@grupposandonato.it</email>
</contrib>
<aff id="aff-1"><label>1</label><institution>Department of Congenital Cardiac Surgery, IRCCS Policlinico San Donato</institution>, <country>San Donato Milanese, Milan, Italy</country></aff>
<aff id="aff-2"><label>2</label><institution>ACHD Unit&#x2013;Pediatric and Adult Congenital Heart Centre, IRCCS Policlinico San Donato</institution>, <country>San Donato Milanese, Milan, Italy</country></aff>
</contrib-group><author-notes><corresp id="cor1"><label>&#x002A;</label>Corresponding Author: Alessandro Giamberti. Email: <email>alessandro.giamberti@grupposandonato.it</email></corresp></author-notes>
<pub-date publication-format="electronic" date-type="pub" iso-8601-date="2022-06-30"><day>30</day>
<month>06</month>
<year>2022</year></pub-date>
<volume>17</volume>
<issue>4</issue>
<fpage>491</fpage>
<lpage>494</lpage>
<history>
<date date-type="received"><day>04</day><month>2</month><year>2022</year></date>
<date date-type="accepted"><day>19</day><month>4</month><year>2022</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2022 Caldaroni et al.</copyright-statement>
<copyright-year>2022</copyright-year>
<copyright-holder>Caldaroni et al.</copyright-holder>
<license xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>This work is licensed under a <ext-link ext-link-type="uri" xlink:type="simple" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</ext-link>, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
</license>
</permissions>
<self-uri content-type="pdf" xlink:href="https://techscience.com/chd/v17n4/19119/TSP_CHD_19119.pdf"></self-uri>
<abstract>
<p>Multimodal imaging, including augmented or mixed reality, transforms the physicians&#x2019; interaction with clinical imaging, allowing more accurate data interpretation, better spatial resolution, and depth perception of the patient&#x2019;s anatomy. We successfully overlay 3D holographic visualization to magnetic resonance imaging images for preoperative decision making of a complex case of cardiac tumour in a 7-year-old girl.</p>
</abstract>
<kwd-group kwd-group-type="author">
<kwd>Hologram</kwd>
<kwd>augmented reality</kwd>
<kwd>multimodal imaging</kwd>
<kwd>3D</kwd>
<kwd>CHD</kwd>
<kwd>cardiac tumour</kwd>
<kwd>arrhythmia</kwd>
<kwd>anatomy</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s1">
<label>1</label>
<title>Introduction</title>
<p>Since the early seventies, when the idea of 3D reality was born, physicians dreamed about holographic technology applied to medical science, aiming to help in clinical diagnosis and surgical practice. Today, what once was only science fiction, has become a ready-to-use technology. Augmented or mixed reality, in fact, accounting for head-sets made of translucent glasses, allows for real-time rendering of holographic 3D contents in the surrounding world, while preserving the interaction with the actual environment [<xref ref-type="bibr" rid="ref-1">1</xref>]. This technology is currently used for education, simulation, and procedural planning in the surgical and/or trans-catheter treatment of patients with congenital and acquired heart disease [<xref ref-type="bibr" rid="ref-2">2</xref>&#x2013;<xref ref-type="bibr" rid="ref-10">10</xref>], but still presents some limitations.</p>
<p>Multimodal imaging can be considered a further step towards personalized medicine. The combination of imaging modalities, in fact, overcomes the limitations of each separate technique [<xref ref-type="bibr" rid="ref-6">6</xref>]. We report our experience with magnetic resonance imaging (MRI) and 3D-holograms technology overlay in decision making of a complex case of cardiac tumour in a child.</p>
</sec>
<sec id="s2">
<label>2</label>
<title>Case Report</title>
<p>A 7-year-old girl, previously healthy, was admitted to the Emergency Department for syncope and wide QRS ventricular tachycardia of unknown origin. Physical examination was unremarkable, and no signs of hemodynamic decompensation were found.</p>
<p>She underwent electrical cardioversion and subsequent complete workup. The ECG-Holter 24 h monitoring demonstrated sinus rhythm with occasional premature ventricular contractions. Echo imaging showed a hyper-echogenic mass in the postero-lateral wall of left ventricle (LV), with preserved ejection fraction (EF &#x003D; 60%). Gadolinium cardiac MRI confirmed the hypodense enhancement of a focal lesion (38 mm &#x00D7; 11 mm &#x00D7; 25 mm) with intramural extension in the postero-lateral wall of the left ventricle, suspicious for cardiac tumour (fibroma or rhabdomyoma). However, MRI could not discriminate if all the cardiac layers were affected, nor cardiac catheterization and CT scan could exclude major vascularization of the cardiac mass from the circumflex artery.</p>
<p>Hence, we created a holographic 3D model to plan how to approach the tumour, discriminating the precise layer&#x2019;s involvement.</p>
<p>Cardiac MRI dynamic sequences in short axis view were used to build the holographic 3D model, using a prototype software platform (ARTINESS srl, Milan, Italy). The holographic 3D model and its overlay with MRI images confirmed that the extension of the tumour was limited to the epicardial and myocardial superficial layers, and thus the feasibility of surgical excision (<xref ref-type="fig" rid="fig-1">Figs. 1</xref> and <xref ref-type="fig" rid="fig-2">2</xref>).</p>
<fig id="fig-1">
<label>Figure 1</label>
<caption>
<title>3D hologram model in short axis view. <italic>T: tumor; LV: Left Ventricle; RV: Right Ventricle; LVPM: Left Ventricular Papillary Muscle</italic></title></caption>
<graphic mimetype="image" mime-subtype="png" xlink:href="CHD_19119-fig-1.png"/>
</fig>
<fig id="fig-2">
<label>Figure 2</label>
<caption>
<title>Overlay of the MRI image with 3D hologram projection. <italic>T: tumor; LV: Left Ventricle; RV: Right Ventricle; LVPM: Left Ventricular Papillary Muscle</italic></title></caption>
<graphic mimetype="image" mime-subtype="png" xlink:href="CHD_19119-fig-2.png"/>
</fig>
<p>During surgery, the same holographic 3D model was displayed in theatre to simulate the incisions and the surgical steps, in order to obtain the best and safest resection of the tumour edges (<xref ref-type="fig" rid="fig-3">Fig. 3</xref>).</p>
<fig id="fig-3">
<label>Figure 3</label>
<caption>
<title>Intra-operative holographic 3D reconstruction to simulate the incisions and the surgical steps performed by the surgeons</title></caption>
<graphic mimetype="image" mime-subtype="png" xlink:href="CHD_19119-fig-3.png"/>
</fig>
<p>Under cardiopulmonary by-pass and cardioplegic cardiac arrest, the patient underwent complete excision of the cardiac tumour without entering the LV cavity, as predicted by the augmented reality.</p>
<p>Histology exam confirmed that the tumour was a large fibroma. The girl was discharged on postoperative day 6<sup>th</sup>, in good clinical conditions and with preserved ventricular function. No more episodes of rhythm disturbances were registered in the following 24 months.</p>
</sec>
<sec id="s3">
<label>3</label>
<title>Discussion</title>
<p>On October 2018 the United States Food and Drug Administration (FDA) authorized, for the first time, mixed reality medical solution HoloLens (Microsoft, Redmond, WA, USA) to be used as preoperative planning resource [<xref ref-type="bibr" rid="ref-7">7</xref>]. 3D analysis of CHD and holographic navigation quickly became promising tools for diagnostic and therapeutic applications and have since been used for education and simulation.</p>
<p>This advanced digital technology and the possibility to have a patient-specific virtual reality, represents a tangible improvement compared to the 3D printed models. In fact, it overcomes its limitation in term of materials selection, long processing times, and costs.</p>
<p>3D holographic technology is today common practice in the pre-operative evaluation of complex CHD in many specialized centres, where multidisciplinary teams try to offer a more &#x201C;personalized&#x201D; approach to the most complex patients [<xref ref-type="bibr" rid="ref-1">1</xref>&#x2013;<xref ref-type="bibr" rid="ref-3">3</xref>,<xref ref-type="bibr" rid="ref-9">9</xref>&#x2013;<xref ref-type="bibr" rid="ref-11">11</xref>].</p>
<p>Current clinical applications include minimally invasive cardiac procedures, mitral valve surgery, and trans-catheter interventional procedures [<xref ref-type="bibr" rid="ref-2">2</xref>,<xref ref-type="bibr" rid="ref-7">7</xref>&#x2013;<xref ref-type="bibr" rid="ref-11">11</xref>].</p>
<p>The potential for the use of 3D-holograms in combination with different imaging modalities in CHD patients would overcome the limitations of each separate technique [<xref ref-type="bibr" rid="ref-6">6</xref>], developing the full potential of augmented reality.</p>
<p>In our case the co-registration with the overlay of functional and structural images from MRI and 3D holographic model was the key to success. To our knowledge, this is the first reported case of augmented reality applied to the surgical excision of cardiac tumours in paediatric patients.</p>
</sec>
</body>
<back><fn-group>
<fn fn-type="other">
<p><bold>Ethics Approval:</bold> The IRCCS San Raffaele institutional review board permitted use of retrospectively collected anonymized data for publication and waived informed consent for the case report.</p>
</fn>
<fn fn-type="other">
<p><bold>Funding Statement:</bold> The authors received no specific funding for this study.</p>
</fn>
<fn fn-type="conflict">
<p><bold>Conflicts of Interest:</bold> The authors declare that they have no conflicts of interest to report regarding the present study.</p>
</fn>
</fn-group>
<ref-list content-type="authoryear">
<title>References</title>
<ref id="ref-1"><label>1.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Bruckheimer</surname>, <given-names>E.</given-names></string-name>, <string-name><surname>Rotschild</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Dagan</surname>, <given-names>T.</given-names></string-name>, <string-name><surname>Amir</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Kaufman</surname>, <given-names>A.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2016</year>). <article-title>Computer-generated real-time digital holography: First time use in clinical medical imaging</article-title>. <source>European Heart Journal&#x2013;Cardiovascular Imaging</source><italic>,</italic> <volume>17</volume><italic>(</italic><issue>8</issue><italic>),</italic> <fpage>845</fpage>&#x2013;<lpage>849</lpage>. DOI <pub-id pub-id-type="doi">10.1093/ehjci/jew087</pub-id>.</mixed-citation></ref>
<ref id="ref-2"><label>2.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Butera</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Sturla</surname>, <given-names>F.</given-names></string-name>, <string-name><surname>Pluchinotta</surname>, <given-names>F. R.</given-names></string-name>, <string-name><surname>Caimi</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Carminati</surname>, <given-names>M.</given-names></string-name></person-group> (<year>2019</year>). <article-title>Holographic augmented reality and 3D printing for advanced planning of sinus venosus ASD/Partial anomalous pulmonary venous return percutaneous management</article-title>. <source>JACC: Cardiovascular Interventions</source><italic>,</italic> <volume>12</volume><italic>(</italic><issue>14</issue><italic>),</italic> <fpage>1389</fpage>&#x2013;<lpage>1391</lpage>. DOI <pub-id pub-id-type="doi">10.1016/j.jcin.2019.03.020</pub-id>.</mixed-citation></ref>
<ref id="ref-3"><label>3.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Brun</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Bugge</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Suther</surname>, <given-names>L.</given-names></string-name>, <string-name><surname>Birkeland</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Kumar</surname>, <given-names>R.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2019</year>). <article-title>Mixed reality holograms for heart surgery planning: First user experience in congenital heart disease</article-title>. <source>European Heart Journal&#x2013;Cardiovascular Imaging</source><italic>,</italic> <volume>20</volume><italic>(</italic><issue>8</issue><italic>),</italic> <fpage>883</fpage>&#x2013;<lpage>888</lpage>. DOI <pub-id pub-id-type="doi">10.1093/ehjci/jey184</pub-id>.</mixed-citation></ref>
<ref id="ref-4"><label>4.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Andolfi</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Plana</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Kania</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Banerjee</surname>, <given-names>P. P.</given-names></string-name>, <string-name><surname>Small</surname>, <given-names>S.</given-names></string-name></person-group> (<year>2017</year>). <article-title>Usefulness of three-dimensional modeling in surgical planning, resident training, and patient education</article-title>. <source>Journal of Laparoendoscopic &#x0026; Advanced Surgical Techniques</source><italic>,</italic> <volume>27</volume><italic>(</italic><issue>5</issue><italic>),</italic> <fpage>512</fpage>&#x2013;<lpage>515</lpage>. DOI <pub-id pub-id-type="doi">10.1089/lap.2016.0421</pub-id>.</mixed-citation></ref>
<ref id="ref-5"><label>5.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Liu</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Al&#x2019;Aref</surname>, <given-names>S. J.</given-names></string-name>, <string-name><surname>Singh</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Caprio</surname>, <given-names>A.</given-names></string-name>, <string-name><surname>Moghadam</surname>, <given-names>A.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2019</year>). <article-title>An augmented reality system for image guidance of transcatheter procedures for structural heart disease</article-title>. <source>PLoS One</source><italic>,</italic> <volume>14</volume><italic>(</italic><issue>7</issue><italic>),</italic> <fpage>e0219174</fpage>. DOI <pub-id pub-id-type="doi">10.1371/journal.pone.0219174</pub-id>.</mixed-citation></ref>
<ref id="ref-6"><label>6.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Alacoque</surname>, <given-names>X.</given-names></string-name>, <string-name><surname>Cuttone</surname>, <given-names>F.</given-names></string-name>, <string-name><surname>Hadeed</surname>, <given-names>K.</given-names></string-name>, <string-name><surname>Karsenty</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Drzazga</surname>, <given-names>P.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2018</year>). <article-title>Multimodal imaging and three-dimensional cardiac computational modelling in the management of congenital heart disease: The secret to getting ahead is to get started</article-title>. <source>Archives of Cardiovascular Diseases</source><italic>,</italic> <volume>111</volume><italic>(</italic><issue>6&#x2013;7</issue><italic>),</italic> <fpage>395</fpage>&#x2013;<lpage>398</lpage>. DOI <pub-id pub-id-type="doi">10.1016/j.acvd.2018.05.002</pub-id>.</mixed-citation></ref>
<ref id="ref-7"><label>7.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Goo</surname>, <given-names>H. W.</given-names></string-name>, <string-name><surname>Park</surname>, <given-names>S. J.</given-names></string-name>, <string-name><surname>Yoo</surname>, <given-names>S. J.</given-names></string-name></person-group> (<year>2020</year>). <article-title>Advanced medical use of three-dimensional imaging in congenital heart disease: Augmented reality, mixed reality, virtual reality, and three-dimensional printing</article-title>. <source>Korean Journal of Radiology</source><italic>,</italic> <volume>21</volume><italic>(</italic><issue>2</issue><italic>),</italic> <fpage>133</fpage>&#x2013;<lpage>145</lpage>. DOI <pub-id pub-id-type="doi">10.3348/kjr.2019.0625</pub-id>.</mixed-citation></ref>
<ref id="ref-8"><label>8.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Gehrsitz</surname>, <given-names>P.</given-names></string-name>, <string-name><surname>Rompel</surname>, <given-names>O.</given-names></string-name>, <string-name><surname>Sch&#x00F6;ber</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Cesnjevar</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Purbojo</surname>, <given-names>A.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2021</year>). <article-title>Cinematic rendering in mixed-reality holograms: A new 3D preoperative planning tool in pediatric heart surgery</article-title>. <source>Frontiers in Cardiovascular Medicine</source><italic>,</italic> <volume>8</volume><italic>,</italic> <fpage>633611</fpage>. DOI <pub-id pub-id-type="doi">10.3389/fcvm.2021.633611</pub-id>.</mixed-citation></ref>
<ref id="ref-9"><label>9.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Pasqualin</surname>, <given-names>G.</given-names></string-name>, <string-name><surname>Sturla</surname>, <given-names>F.</given-names></string-name>, <string-name><surname>D&#x2019;Aiello</surname>, <given-names>A. F.</given-names></string-name>, <string-name><surname>Chessa</surname>, <given-names>M.</given-names></string-name></person-group> (<year>2021</year>). <article-title>Mixed reality navigation of a systemic venous baffle obstruction: Unravelling the percutaneous approach in atrial switch operation</article-title>. <source>European Heart Journal</source><italic>,</italic> <volume>42</volume><italic>(</italic><issue>41</issue><italic>),</italic> <fpage>4284</fpage>. DOI <pub-id pub-id-type="doi">10.1093/eurheartj/ehaa961</pub-id>.</mixed-citation></ref>
<ref id="ref-10"><label>10.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ender</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Koncar-Zeh</surname>, <given-names>J.</given-names></string-name>, <string-name><surname>Mukherjee</surname>, <given-names>C.</given-names></string-name>, <string-name><surname>Jacobs</surname>, <given-names>S.</given-names></string-name>, <string-name><surname>Borger</surname>, <given-names>M. A.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2008</year>). <article-title>Value of augmented reality-enhanced transesophageal echocardiography (TEE) for determining optimal annuloplasty ring size during mitral valve repair</article-title>. <source>The Annals of Thoracic Surgery</source><italic>,</italic> <volume>86</volume><italic>(</italic><issue>5</issue><italic>),</italic> <fpage>1473</fpage>&#x2013;<lpage>1478</lpage>. DOI <pub-id pub-id-type="doi">10.1016/j.athoracsur.2008.07.073</pub-id>.</mixed-citation></ref>
<ref id="ref-11"><label>11.</label><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Belhaj Soulami</surname>, <given-names>R.</given-names></string-name>, <string-name><surname>Verhoye</surname>, <given-names>J. P.</given-names></string-name>, <string-name><surname>Nguyen Duc</surname>, <given-names>H.</given-names></string-name>, <string-name><surname>Castro</surname>, <given-names>M.</given-names></string-name>, <string-name><surname>Auffret</surname>, <given-names>V.</given-names></string-name> <etal>et al.</etal></person-group> (<year>2016</year>). <article-title>Computer-assisted transcatheter heart valve implantation in valve-in-valve procedures</article-title>. <source>Innovations</source><italic>,</italic> <volume>11</volume><italic>(</italic><issue>3</issue><italic>),</italic> <fpage>193</fpage>&#x2013;<lpage>200</lpage>. DOI <pub-id pub-id-type="doi">10.1097/imi.0000000000000259</pub-id>.</mixed-citation></ref>
</ref-list>
</back>
</article>