A Virtual Reality System for PTCD Simulation Using Direct Visuo-Haptic Rendering of Partially Segmented Image Data

This study presents a new visuo-haptic virtual reality (VR) training and planning system for percutaneous transhepatic cholangio-drainage (PTCD) based on partially segmented virtual patient models. We only use partially segmented image data instead of a full segmentation and circumvent the necessity...

Full description

Saved in:
Bibliographic Details
Published in:IEEE journal of biomedical and health informatics 2016-01, Vol.20 (1), p.355-366
Main Authors: Fortmeier, Dirk, Mastmeyer, Andre, Schroder, Julian, Handels, Heinz
Format: Article
Language:English
Subjects:
Algorithms
Biliary Tract Surgical Procedures - education
Computer Simulation
Deformation
Digestive System Surgical Procedures - education
Drainage - methods
Equipment Design
Force
Haptic interfaces
Haptic Rendering
Humans
Image segmentation
Imaging, Three-Dimensional - methods
Liver - surgery
Needle Insertion
Needles
Patients
Rendering
Rendering (computer graphics)
Solid modeling
Springs
Training
Ultrasonic imaging
User-Computer Interface
Virtual reality
Visualization
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This study presents a new visuo-haptic virtual reality (VR) training and planning system for percutaneous transhepatic cholangio-drainage (PTCD) based on partially segmented virtual patient models. We only use partially segmented image data instead of a full segmentation and circumvent the necessity of surface or volume mesh models. Haptic interaction with the virtual patient during virtual palpation, ultrasound probing and needle insertion is provided. Furthermore, the VR simulator includes X-ray and ultrasound simulation for image-guided training. The visualization techniques are GPU-accelerated by implementation in Cuda and include real-time volume deformations computed on the grid of the image data. Computation on the image grid enables straightforward integration of the deformed image data into the visualization components. To provide shorter rendering times, the performance of the volume deformation algorithm is improved by a multigrid approach. To evaluate the VR training system, a user evaluation has been performed and deformation algorithms are analyzed in terms of convergence speed with respect to a fully converged solution. The user evaluation shows positive results with increased user confidence after a training session. It is shown that using partially segmented patient data and direct volume rendering is suitable for the simulation of needle insertion procedures such as PTCD.
ISSN:2168-2194
2168-2208
DOI:10.1109/JBHI.2014.2381772