A Virtual Reality System for PTCD Simulation Using Direct Visuo-Haptic Rendering of Partially Segmented Image Data

This study presents a new visuo-haptic virtual reality (VR) training and planning system for percutaneous transhepatic cholangio-drainage (PTCD) based on partially segmented virtual patient models. We only use partially segmented image data instead of a full segmentation and circumvent the necessity...

Full description

Saved in:
Bibliographic Details
Published in:IEEE journal of biomedical and health informatics 2016-01, Vol.20 (1), p.355-366
Main Authors: Fortmeier, Dirk, Mastmeyer, Andre, Schroder, Julian, Handels, Heinz
Format: Article
Language:English
Subjects:
Algorithms
Biliary Tract Surgical Procedures - education
Computer Simulation
Deformation
Digestive System Surgical Procedures - education
Drainage - methods
Equipment Design
Force
Haptic interfaces
Haptic Rendering
Humans
Image segmentation
Imaging, Three-Dimensional - methods
Liver - surgery
Needle Insertion
Needles
Patients
Rendering
Rendering (computer graphics)
Solid modeling
Springs
Training
Ultrasonic imaging
User-Computer Interface
Virtual reality
Visualization
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c415t-7f0143c245911a777ad4a32fcd7f288a3c4a3f2875b49ffb9e321cc3338d6d463
cites cdi_FETCH-LOGICAL-c415t-7f0143c245911a777ad4a32fcd7f288a3c4a3f2875b49ffb9e321cc3338d6d463
container_end_page 366
container_issue 1
container_start_page 355
container_title IEEE journal of biomedical and health informatics
container_volume 20
creator Fortmeier, Dirk
Mastmeyer, Andre
Schroder, Julian
Handels, Heinz
description This study presents a new visuo-haptic virtual reality (VR) training and planning system for percutaneous transhepatic cholangio-drainage (PTCD) based on partially segmented virtual patient models. We only use partially segmented image data instead of a full segmentation and circumvent the necessity of surface or volume mesh models. Haptic interaction with the virtual patient during virtual palpation, ultrasound probing and needle insertion is provided. Furthermore, the VR simulator includes X-ray and ultrasound simulation for image-guided training. The visualization techniques are GPU-accelerated by implementation in Cuda and include real-time volume deformations computed on the grid of the image data. Computation on the image grid enables straightforward integration of the deformed image data into the visualization components. To provide shorter rendering times, the performance of the volume deformation algorithm is improved by a multigrid approach. To evaluate the VR training system, a user evaluation has been performed and deformation algorithms are analyzed in terms of convergence speed with respect to a fully converged solution. The user evaluation shows positive results with increased user confidence after a training session. It is shown that using partially segmented patient data and direct volume rendering is suitable for the simulation of needle insertion procedures such as PTCD.
doi_str_mv 10.1109/JBHI.2014.2381772
format article
fullrecord <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_proquest_miscellaneous_1765956986</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>6987232</ieee_id><sourcerecordid>1765956986</sourcerecordid><originalsourceid>FETCH-LOGICAL-c415t-7f0143c245911a777ad4a32fcd7f288a3c4a3f2875b49ffb9e321cc3338d6d463</originalsourceid><addsrcrecordid>eNqNkUtPGzEUha2qqCDgB6BKlaVuupkwfnuWkLQkCKmoPLYjx3MdGc0j2J5F_n09SmDBCm987fudIx0dhC5IOSOkrC5vr5erGS0Jn1GmiVL0CzqhROqC0lJ_fZtJxY_ReYwvZT46f1XyGzqmQrC8UicoXOFnH9JoWvwPTOvTDj_sYoIOuyHg-8f5Aj_4bmxN8kOPn6LvN3jhA9iUdXEciqXZJm-zuG8gTNvB4XsTkjdtm71g00GfoMGrzmwAL0wyZ-jImTbC-eE-RU9_fj_Ol8Xd35vV_OqusJyIVCiXszFLuagIMUop03DDqLONclRrw2x-5kmJNa-cW1eQI1nLGNONbLhkp-jX3ncbhtcRYqo7Hy20relhGGNNlJa0ZFSRT6BSVEJW-jOuggvKNS8z-vMD-jKMoc-ZJ4oxQqXUmSJ7yoYhxgCu3gbfmbCrSVlPTddT0_XUdH1oOmt-HJzHdQfNu-Kt1wx83wMeAN7XOUAWU_Yf3yyp4g</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1753312668</pqid></control><display><type>article</type><title>A Virtual Reality System for PTCD Simulation Using Direct Visuo-Haptic Rendering of Partially Segmented Image Data</title><source>IEEE Electronic Library (IEL) Journals</source><creator>Fortmeier, Dirk ; Mastmeyer, Andre ; Schroder, Julian ; Handels, Heinz</creator><creatorcontrib>Fortmeier, Dirk ; Mastmeyer, Andre ; Schroder, Julian ; Handels, Heinz</creatorcontrib><description>This study presents a new visuo-haptic virtual reality (VR) training and planning system for percutaneous transhepatic cholangio-drainage (PTCD) based on partially segmented virtual patient models. We only use partially segmented image data instead of a full segmentation and circumvent the necessity of surface or volume mesh models. Haptic interaction with the virtual patient during virtual palpation, ultrasound probing and needle insertion is provided. Furthermore, the VR simulator includes X-ray and ultrasound simulation for image-guided training. The visualization techniques are GPU-accelerated by implementation in Cuda and include real-time volume deformations computed on the grid of the image data. Computation on the image grid enables straightforward integration of the deformed image data into the visualization components. To provide shorter rendering times, the performance of the volume deformation algorithm is improved by a multigrid approach. To evaluate the VR training system, a user evaluation has been performed and deformation algorithms are analyzed in terms of convergence speed with respect to a fully converged solution. The user evaluation shows positive results with increased user confidence after a training session. It is shown that using partially segmented patient data and direct volume rendering is suitable for the simulation of needle insertion procedures such as PTCD.</description><identifier>ISSN: 2168-2194</identifier><identifier>EISSN: 2168-2208</identifier><identifier>DOI: 10.1109/JBHI.2014.2381772</identifier><identifier>PMID: 25532197</identifier><identifier>CODEN: IJBHA9</identifier><language>eng</language><publisher>United States: IEEE</publisher><subject>Algorithms ; Biliary Tract Surgical Procedures - education ; Computer Simulation ; Deformation ; Digestive System Surgical Procedures - education ; Drainage - methods ; Equipment Design ; Force ; Haptic interfaces ; Haptic Rendering ; Humans ; Image segmentation ; Imaging, Three-Dimensional - methods ; Liver - surgery ; Needle Insertion ; Needles ; Patients ; Rendering ; Rendering (computer graphics) ; Solid modeling ; Springs ; Training ; Ultrasonic imaging ; User-Computer Interface ; Virtual reality ; Visualization</subject><ispartof>IEEE journal of biomedical and health informatics, 2016-01, Vol.20 (1), p.355-366</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2016</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c415t-7f0143c245911a777ad4a32fcd7f288a3c4a3f2875b49ffb9e321cc3338d6d463</citedby><cites>FETCH-LOGICAL-c415t-7f0143c245911a777ad4a32fcd7f288a3c4a3f2875b49ffb9e321cc3338d6d463</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/6987232$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>315,786,790,27957,27958,55147</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/25532197$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Fortmeier, Dirk</creatorcontrib><creatorcontrib>Mastmeyer, Andre</creatorcontrib><creatorcontrib>Schroder, Julian</creatorcontrib><creatorcontrib>Handels, Heinz</creatorcontrib><title>A Virtual Reality System for PTCD Simulation Using Direct Visuo-Haptic Rendering of Partially Segmented Image Data</title><title>IEEE journal of biomedical and health informatics</title><addtitle>JBHI</addtitle><addtitle>IEEE J Biomed Health Inform</addtitle><description>This study presents a new visuo-haptic virtual reality (VR) training and planning system for percutaneous transhepatic cholangio-drainage (PTCD) based on partially segmented virtual patient models. We only use partially segmented image data instead of a full segmentation and circumvent the necessity of surface or volume mesh models. Haptic interaction with the virtual patient during virtual palpation, ultrasound probing and needle insertion is provided. Furthermore, the VR simulator includes X-ray and ultrasound simulation for image-guided training. The visualization techniques are GPU-accelerated by implementation in Cuda and include real-time volume deformations computed on the grid of the image data. Computation on the image grid enables straightforward integration of the deformed image data into the visualization components. To provide shorter rendering times, the performance of the volume deformation algorithm is improved by a multigrid approach. To evaluate the VR training system, a user evaluation has been performed and deformation algorithms are analyzed in terms of convergence speed with respect to a fully converged solution. The user evaluation shows positive results with increased user confidence after a training session. It is shown that using partially segmented patient data and direct volume rendering is suitable for the simulation of needle insertion procedures such as PTCD.</description><subject>Algorithms</subject><subject>Biliary Tract Surgical Procedures - education</subject><subject>Computer Simulation</subject><subject>Deformation</subject><subject>Digestive System Surgical Procedures - education</subject><subject>Drainage - methods</subject><subject>Equipment Design</subject><subject>Force</subject><subject>Haptic interfaces</subject><subject>Haptic Rendering</subject><subject>Humans</subject><subject>Image segmentation</subject><subject>Imaging, Three-Dimensional - methods</subject><subject>Liver - surgery</subject><subject>Needle Insertion</subject><subject>Needles</subject><subject>Patients</subject><subject>Rendering</subject><subject>Rendering (computer graphics)</subject><subject>Solid modeling</subject><subject>Springs</subject><subject>Training</subject><subject>Ultrasonic imaging</subject><subject>User-Computer Interface</subject><subject>Virtual reality</subject><subject>Visualization</subject><issn>2168-2194</issn><issn>2168-2208</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><recordid>eNqNkUtPGzEUha2qqCDgB6BKlaVuupkwfnuWkLQkCKmoPLYjx3MdGc0j2J5F_n09SmDBCm987fudIx0dhC5IOSOkrC5vr5erGS0Jn1GmiVL0CzqhROqC0lJ_fZtJxY_ReYwvZT46f1XyGzqmQrC8UicoXOFnH9JoWvwPTOvTDj_sYoIOuyHg-8f5Aj_4bmxN8kOPn6LvN3jhA9iUdXEciqXZJm-zuG8gTNvB4XsTkjdtm71g00GfoMGrzmwAL0wyZ-jImTbC-eE-RU9_fj_Ol8Xd35vV_OqusJyIVCiXszFLuagIMUop03DDqLONclRrw2x-5kmJNa-cW1eQI1nLGNONbLhkp-jX3ncbhtcRYqo7Hy20relhGGNNlJa0ZFSRT6BSVEJW-jOuggvKNS8z-vMD-jKMoc-ZJ4oxQqXUmSJ7yoYhxgCu3gbfmbCrSVlPTddT0_XUdH1oOmt-HJzHdQfNu-Kt1wx83wMeAN7XOUAWU_Yf3yyp4g</recordid><startdate>201601</startdate><enddate>201601</enddate><creator>Fortmeier, Dirk</creator><creator>Mastmeyer, Andre</creator><creator>Schroder, Julian</creator><creator>Handels, Heinz</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QF</scope><scope>7QO</scope><scope>7QQ</scope><scope>7SC</scope><scope>7SE</scope><scope>7SP</scope><scope>7SR</scope><scope>7TA</scope><scope>7TB</scope><scope>7U5</scope><scope>8BQ</scope><scope>8FD</scope><scope>F28</scope><scope>FR3</scope><scope>H8D</scope><scope>JG9</scope><scope>JQ2</scope><scope>K9.</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>NAPCQ</scope><scope>P64</scope><scope>7X8</scope></search><sort><creationdate>201601</creationdate><title>A Virtual Reality System for PTCD Simulation Using Direct Visuo-Haptic Rendering of Partially Segmented Image Data</title><author>Fortmeier, Dirk ; Mastmeyer, Andre ; Schroder, Julian ; Handels, Heinz</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c415t-7f0143c245911a777ad4a32fcd7f288a3c4a3f2875b49ffb9e321cc3338d6d463</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Algorithms</topic><topic>Biliary Tract Surgical Procedures - education</topic><topic>Computer Simulation</topic><topic>Deformation</topic><topic>Digestive System Surgical Procedures - education</topic><topic>Drainage - methods</topic><topic>Equipment Design</topic><topic>Force</topic><topic>Haptic interfaces</topic><topic>Haptic Rendering</topic><topic>Humans</topic><topic>Image segmentation</topic><topic>Imaging, Three-Dimensional - methods</topic><topic>Liver - surgery</topic><topic>Needle Insertion</topic><topic>Needles</topic><topic>Patients</topic><topic>Rendering</topic><topic>Rendering (computer graphics)</topic><topic>Solid modeling</topic><topic>Springs</topic><topic>Training</topic><topic>Ultrasonic imaging</topic><topic>User-Computer Interface</topic><topic>Virtual reality</topic><topic>Visualization</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Fortmeier, Dirk</creatorcontrib><creatorcontrib>Mastmeyer, Andre</creatorcontrib><creatorcontrib>Schroder, Julian</creatorcontrib><creatorcontrib>Handels, Heinz</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEL</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Aluminium Industry Abstracts</collection><collection>Biotechnology Research Abstracts</collection><collection>Ceramic Abstracts</collection><collection>Computer and Information Systems Abstracts</collection><collection>Corrosion Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>Materials Business File</collection><collection>Mechanical &amp; Transportation Engineering Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>ANTE: Abstracts in New Technology &amp; Engineering</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>MEDLINE - Academic</collection><jtitle>IEEE journal of biomedical and health informatics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Fortmeier, Dirk</au><au>Mastmeyer, Andre</au><au>Schroder, Julian</au><au>Handels, Heinz</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Virtual Reality System for PTCD Simulation Using Direct Visuo-Haptic Rendering of Partially Segmented Image Data</atitle><jtitle>IEEE journal of biomedical and health informatics</jtitle><stitle>JBHI</stitle><addtitle>IEEE J Biomed Health Inform</addtitle><date>2016-01</date><risdate>2016</risdate><volume>20</volume><issue>1</issue><spage>355</spage><epage>366</epage><pages>355-366</pages><issn>2168-2194</issn><eissn>2168-2208</eissn><coden>IJBHA9</coden><notes>ObjectType-Article-1</notes><notes>SourceType-Scholarly Journals-1</notes><notes>ObjectType-Feature-2</notes><notes>content type line 23</notes><abstract>This study presents a new visuo-haptic virtual reality (VR) training and planning system for percutaneous transhepatic cholangio-drainage (PTCD) based on partially segmented virtual patient models. We only use partially segmented image data instead of a full segmentation and circumvent the necessity of surface or volume mesh models. Haptic interaction with the virtual patient during virtual palpation, ultrasound probing and needle insertion is provided. Furthermore, the VR simulator includes X-ray and ultrasound simulation for image-guided training. The visualization techniques are GPU-accelerated by implementation in Cuda and include real-time volume deformations computed on the grid of the image data. Computation on the image grid enables straightforward integration of the deformed image data into the visualization components. To provide shorter rendering times, the performance of the volume deformation algorithm is improved by a multigrid approach. To evaluate the VR training system, a user evaluation has been performed and deformation algorithms are analyzed in terms of convergence speed with respect to a fully converged solution. The user evaluation shows positive results with increased user confidence after a training session. It is shown that using partially segmented patient data and direct volume rendering is suitable for the simulation of needle insertion procedures such as PTCD.</abstract><cop>United States</cop><pub>IEEE</pub><pmid>25532197</pmid><doi>10.1109/JBHI.2014.2381772</doi><tpages>12</tpages></addata></record>
fulltext fulltext
identifier ISSN: 2168-2194
ispartof IEEE journal of biomedical and health informatics, 2016-01, Vol.20 (1), p.355-366
issn 2168-2194
2168-2208
language eng
recordid cdi_proquest_miscellaneous_1765956986
source IEEE Electronic Library (IEL) Journals
subjects Algorithms
Biliary Tract Surgical Procedures - education
Computer Simulation
Deformation
Digestive System Surgical Procedures - education
Drainage - methods
Equipment Design
Force
Haptic interfaces
Haptic Rendering
Humans
Image segmentation
Imaging, Three-Dimensional - methods
Liver - surgery
Needle Insertion
Needles
Patients
Rendering
Rendering (computer graphics)
Solid modeling
Springs
Training
Ultrasonic imaging
User-Computer Interface
Virtual reality
Visualization
title A Virtual Reality System for PTCD Simulation Using Direct Visuo-Haptic Rendering of Partially Segmented Image Data
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-09-22T08%3A48%3A40IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Virtual%20Reality%20System%20for%20PTCD%20Simulation%20Using%20Direct%20Visuo-Haptic%20Rendering%20of%20Partially%20Segmented%20Image%20Data&rft.jtitle=IEEE%20journal%20of%20biomedical%20and%20health%20informatics&rft.au=Fortmeier,%20Dirk&rft.date=2016-01&rft.volume=20&rft.issue=1&rft.spage=355&rft.epage=366&rft.pages=355-366&rft.issn=2168-2194&rft.eissn=2168-2208&rft.coden=IJBHA9&rft_id=info:doi/10.1109/JBHI.2014.2381772&rft_dat=%3Cproquest_pubme%3E1765956986%3C/proquest_pubme%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c415t-7f0143c245911a777ad4a32fcd7f288a3c4a3f2875b49ffb9e321cc3338d6d463%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=1753312668&rft_id=info:pmid/25532197&rft_ieee_id=6987232&rfr_iscdi=true