How to get this document?

Download
Commercial Copyright fee: €14.50 Basic fee: €4.00 Total price: €18.50
Academic Copyright fee: €4.50 Basic fee: €2.00 Total price: €6.50

Motivated by the potential of holographic augmented reality (AR) to offer an immersive 3D appreciation of morphology and anatomy, the purpose of this work is to develop and assess an interface for image-based planning of prostate interventions with a head-mounted display (HMD). The computational system is a data and command pipeline that links a magnetic resonance imaging (MRI) scanner/data and the operator, that includes modules dedicated to image processing and segmentation, structure rendering, trajectory planning and spatial co-registration. The interface was developed with the Unity3D Engine (C#) and deployed and tested on a HoloLens HMD. For ergonomics in the surgical suite, the system was endowed with hands-free interactive manipulation of images and the holographic scene via hand gestures and voice commands. The system was tested in silico using MRI and ultrasound datasets of prostate phantoms. The holographic AR scene rendered by the HoloLens HMD was subjectively found superior to desktop-based volume or 3D rendering with regard to structure detection and appreciation of spatial relationships, planning access paths and manual co-registration of MRI and Ultrasound. By inspecting the virtual trajectory superimposed to rendered structures and MR images, the operator observes collisions of the needle path with vital structures (e.g. urethra) and adjusts accordingly. Holographic AR interfacing with wireless HMD endowed with hands-free gesture and voice control is a promising technology. Studies need to systematically assess the clinical merit of such systems and needed functionalities.

Table of contents conference proceedings

The tables of contents are generated automatically and are based on the data records of the individual contributions available in the index of the TIB portal. The display of the Tables of Contents may therefore be incomplete.

1
Ultrasound Decompression for Large Field-of-View Reconstructions
Schulte zu Berge, Christian / Salehi, Mehrdad / Bender, Frederik / Wein, Wolfgang | 2018
11
ICG based Augmented-Reality-System for Sentinel Lymph Node Biopsy
Noll, Matthias / Noa-Rudolph, Werner / Wesarg, Stefan / Kraly, Michael / Stoffels, Ingo / Klode, Joachim / Spass, Cédric / Spass, Gerrit | 2018
17
A Prototype Holographic Augmented Reality Interface for Image-Guided Prostate Cancer Interventions
Morales Mojica, Cristina M. / Velazco Garcia, Jose D. / Navkar, Nikhil V. / Balakrishnan, Shidin / Abinahed, Julien / El Ansari, Walid / Al-Rumaihi, Khalid / Darweesh, Adham / Al-Ansari, Abdulla / Gharib, Mohamed et al. | 2018
23
Visual Analytics in Histopathology Diagnostics: a Protocol-Based Approach
Corvò, Alberto / Westenberg, Michel A. / Driel, Marc A. van / Wijk, Jarke J.van | 2018
33
Automatic Generation of Web-Based User Studies to Evaluate Depth Perception in Vascular Surface Visualizations
Meuschke, Monique / Smit, Noeska N. / Lichtenberg, Nils / Preim, Bernhard / Lawonn, Kai | 2018
45
A Critical Analysis of the Evaluation Practice in Medical Visualization
Preim, Bernhard / Ropinski, Timo / Isenberg, Petra | 2018
57
Annotated Dendrograms for Neurons From the Larval Fruit Fly Brain
Strauch, Martin / Hartenstein, Volker / Andrade, Ingrid V. / Cardona, Albert / Merhof, Dorit | 2018
67
A Multilinear Model for Bidirectional Craniofacial Reconstruction
Achenbach, Jascha / Brylka, Robert / Gietzen, Thomas / Hebel, Katja zum / Schömer, Elmar / Schulze, Ralf / Botsch, Mario / Schwanecke, Ulrich | 2018
77
Iterative Exploration of Big Brain Network Data
Ganglberger, Florian / Swoboda, Nicolas / Frauenstein, Lisa / Kaczanowska, Joanna / Haubensak, Wulf / Bühler, Katja | 2018
89
Progressive and Efficient Multi-Resolution Representations for Brain Tractograms
Mercier, Corentin / Gori, Pietro / Rohmer, Damien / Cani, Marie-Paule / Boubekeur, Tamy / Thiery, Jean-Marc / Bloch, Isabelle | 2018
95
Visual Analysis of Evolution of EEG Coherence Networks employing Temporal Multidimensional Scaling
Ji, Chengtao / Maurits, Natasha M. / Roerdink, Jos B. T. M. | 2018
101
Introducing CNN-Based Mouse Grim Scale Analysis for Fully Automated Image-Based Assessment of Distress in Laboratory Mice
Kopaczka, Marcin / Ernst, Lisa / Schock, Justus / Schneuing, Arne / Guth, Alexander / Tolba, Rene / Merhof, Dorit | 2018
107
Uncertainty-Guided Semi-Automated Editing of CNN-based Retinal Layer Segmentations in Optical Coherence Tomography
Zadeh, Shekoufeh Gorgi / Wintergerst, Maximilian W. M. / Schultz, Thomas | 2018
117
A Framework for Visual Comparison of 4D PC-MRI Aortic Blood Flow Data
Behrendt, Benjamin / Ebel, Sebastian / Gutberlet, Matthias / Preim, Bernhard | 2018
123
A New Vessel Enhancement Transform on Retinal Blood Vessels Segmentation
Soares, Ivo / Castelo-Branco, Miguel / Pinheiro, António M. G. | 2018
129
Visual Assessment of Vascular Torsion using Ellipse Fitting
Mistelbauer, Gabriel / Zettwitz, Martin / Schernthaner, Rüdiger / Fleischmann, Dominik / Teutsch, Christian / Preim, Bernhard | 2018
135
Visual Analysis of Regional Anomalies in Myocardial Motion
Sheharyar, Ali / Ruh, Alexander / Aristova, Maria / Scott, Michael / Jarvis, Kelly / Elbaz, Mohammed / Dolan, Ryan / Schnell, Susanne / Lin, Kal / Carr, James et al. | 2018
145
Parameterization and Feature Extraction for the Visualization of Tree-like Structures
Lichtenberg, Nils / Lawonn, Kai | 2018
157
Estimation of Muscle Activity in One-Leg Stance from 3D Surface Deformation
Metzler, Johannes / Neumann, Thomas / Gassel, Stefanie / Friedrich, Jens / Wacker, Markus | 2018
167
VisualFlatter - Visual Analysis of Distortions in the Projection of Biomedical Structures
Grossmann, Nicolas / Köppel, Thomas / Gröller, Eduard / Raidou, Renata Georgia | 2018
179
Global and Local Mesh Morphing for Complex Biological Objects from µCT Data
Knötel, David / Becker, Carola / Scholtz, Gerhard / Baum, Daniel | 2018
185
Improving Perception of Molecular Surface Visualizations by Incorporating Translucency Effects
Hermosilla, Pedro / Maisch, Sebastian / Vázquez, Pere-Pau / Ropinski, Timo | 2018
197
Semantic Screen-Space Occlusion for Multiscale Molecular Visualization
Koch, Thomas Bernhard / Kouril, David / Klein, Tobias / Mindek, Peter / Viola, Ivan | 2018
203
Visual Exploratory Analysis for Multiple T-Maze Studies
Bechtold, Fabrizia / Splechtna, Rainer / Matkovic, Kresimir | 2018