Three-dimensional sound-field visualization system using head mounted display and stereo camera

Visualization of a sound field helps us to intuitively understand various acoustic phenomena in sound design and education. The most straightforward method is to overlap the measured data onto a photographic image. However, in order to understand an entire three-dimensional (3D) sound field by using...

Full description

Saved in:
Bibliographic Details
Main Authors: Inoue, Atsuto, Ikeda, Yusuke, Yatabe, Kohei, Oikawa, Yasuhiro
Format: Conference Proceeding
Language:English
Citations: Items that cite this one
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c2811-68048d3d0f3821e6cc85c2be083cb5805fad496894a0dc1afcdfbf06f8415cb33
cites
container_end_page
container_issue 1
container_start_page
container_title
container_volume 29
creator Inoue, Atsuto
Ikeda, Yusuke
Yatabe, Kohei
Oikawa, Yasuhiro
description Visualization of a sound field helps us to intuitively understand various acoustic phenomena in sound design and education. The most straightforward method is to overlap the measured data onto a photographic image. However, in order to understand an entire three-dimensional (3D) sound field by using a conventional two-dimensional screen, it is necessary to move a camera and measure repeatedly. On the other hand, the augmented reality (AR) techniques such as an video see-through head mounted display (VST-HMD) have been rapidly developed. In this study, we propose a sound field visualization system using an VST-HMD and a hand held four-point microphone. This system calculates sound intensity from the four sound signals in real time. Then, the sound intensity distribution is depicted as arrows in the 3D display. The position and angle of the microphones and users head are acquired via AR markers and head tracking sensors of the VST-HMD. The system realizes simple and effective visualization of 3D sound field information from the various directions and positions of view. For the experiments, the sound fields generated by loudspeakers and motorcycles were visualized. The results suggested that the proposed system can present information of the field in easily recognizable manner.
doi_str_mv 10.1121/2.0000381
format conference_proceeding
fullrecord <record><control><sourceid>scitation_AJDQP</sourceid><recordid>TN_cdi_scitation_primary_10_1121_2_0000381</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>poma</sourcerecordid><originalsourceid>FETCH-LOGICAL-c2811-68048d3d0f3821e6cc85c2be083cb5805fad496894a0dc1afcdfbf06f8415cb33</originalsourceid><addsrcrecordid>eNp9kM1LAzEQxYMgWKsH_4Ocha0zye6SPUrxCwpeKngLs5nERvajbLaF-te72oI33-Ud3u8NwxPiBmGBqPBOLWCSNngmZljpKjMA7xfiMqVPgBJVWcyEXW8G7zOOre9S7DtqZOp3HWch-oblPqYdNfGLximT6ZBG38pdit2H3Hhi2U7s6FlyTNuGDpI6lhMz-F46av1AV-I8UJP89cnn4u3xYb18zlavTy_L-1XmlEHMSgO5Yc0QtFHoS-dM4VTtwWhXFwaKQJxXpalyAnZIwXGoA5TB5Fi4Wuu5uD3eTS6Ov9_a7RBbGg523w9W2dMUdsvhPxjB_mz3V9DfR3RlAw</addsrcrecordid><sourcetype>Enrichment Source</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>Three-dimensional sound-field visualization system using head mounted display and stereo camera</title><source>AIP Open Access Journals</source><creator>Inoue, Atsuto ; Ikeda, Yusuke ; Yatabe, Kohei ; Oikawa, Yasuhiro</creator><creatorcontrib>Inoue, Atsuto ; Ikeda, Yusuke ; Yatabe, Kohei ; Oikawa, Yasuhiro</creatorcontrib><description>Visualization of a sound field helps us to intuitively understand various acoustic phenomena in sound design and education. The most straightforward method is to overlap the measured data onto a photographic image. However, in order to understand an entire three-dimensional (3D) sound field by using a conventional two-dimensional screen, it is necessary to move a camera and measure repeatedly. On the other hand, the augmented reality (AR) techniques such as an video see-through head mounted display (VST-HMD) have been rapidly developed. In this study, we propose a sound field visualization system using an VST-HMD and a hand held four-point microphone. This system calculates sound intensity from the four sound signals in real time. Then, the sound intensity distribution is depicted as arrows in the 3D display. The position and angle of the microphones and users head are acquired via AR markers and head tracking sensors of the VST-HMD. The system realizes simple and effective visualization of 3D sound field information from the various directions and positions of view. For the experiments, the sound fields generated by loudspeakers and motorcycles were visualized. The results suggested that the proposed system can present information of the field in easily recognizable manner.</description><identifier>EISSN: 1939-800X</identifier><identifier>DOI: 10.1121/2.0000381</identifier><identifier>CODEN: PMARCW</identifier><language>eng</language><ispartof>Proceedings of Meetings on Acoustics, 2016, Vol.29 (1)</ispartof><rights>Acoustical Society of America</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c2811-68048d3d0f3821e6cc85c2be083cb5805fad496894a0dc1afcdfbf06f8415cb33</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://pubs.aip.org/poma/article-lookup/doi/10.1121/2.0000381$$EHTML$$P50$$Gscitation$$H</linktohtml><link.rule.ids>310,311,786,790,795,796,23958,23959,25170,27923,27958,76766</link.rule.ids><linktorsrc>$$Uhttp://dx.doi.org/10.1121/2.0000381$$EView_record_in_American_Institute_of_Physics$$FView_record_in_$$GAmerican_Institute_of_Physics</linktorsrc></links><search><creatorcontrib>Inoue, Atsuto</creatorcontrib><creatorcontrib>Ikeda, Yusuke</creatorcontrib><creatorcontrib>Yatabe, Kohei</creatorcontrib><creatorcontrib>Oikawa, Yasuhiro</creatorcontrib><title>Three-dimensional sound-field visualization system using head mounted display and stereo camera</title><title>Proceedings of Meetings on Acoustics</title><description>Visualization of a sound field helps us to intuitively understand various acoustic phenomena in sound design and education. The most straightforward method is to overlap the measured data onto a photographic image. However, in order to understand an entire three-dimensional (3D) sound field by using a conventional two-dimensional screen, it is necessary to move a camera and measure repeatedly. On the other hand, the augmented reality (AR) techniques such as an video see-through head mounted display (VST-HMD) have been rapidly developed. In this study, we propose a sound field visualization system using an VST-HMD and a hand held four-point microphone. This system calculates sound intensity from the four sound signals in real time. Then, the sound intensity distribution is depicted as arrows in the 3D display. The position and angle of the microphones and users head are acquired via AR markers and head tracking sensors of the VST-HMD. The system realizes simple and effective visualization of 3D sound field information from the various directions and positions of view. For the experiments, the sound fields generated by loudspeakers and motorcycles were visualized. The results suggested that the proposed system can present information of the field in easily recognizable manner.</description><issn>1939-800X</issn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2016</creationdate><recordtype>conference_proceeding</recordtype><sourceid/><recordid>eNp9kM1LAzEQxYMgWKsH_4Ocha0zye6SPUrxCwpeKngLs5nERvajbLaF-te72oI33-Ud3u8NwxPiBmGBqPBOLWCSNngmZljpKjMA7xfiMqVPgBJVWcyEXW8G7zOOre9S7DtqZOp3HWch-oblPqYdNfGLximT6ZBG38pdit2H3Hhi2U7s6FlyTNuGDpI6lhMz-F46av1AV-I8UJP89cnn4u3xYb18zlavTy_L-1XmlEHMSgO5Yc0QtFHoS-dM4VTtwWhXFwaKQJxXpalyAnZIwXGoA5TB5Fi4Wuu5uD3eTS6Ov9_a7RBbGg523w9W2dMUdsvhPxjB_mz3V9DfR3RlAw</recordid><startdate>20161128</startdate><enddate>20161128</enddate><creator>Inoue, Atsuto</creator><creator>Ikeda, Yusuke</creator><creator>Yatabe, Kohei</creator><creator>Oikawa, Yasuhiro</creator><scope/></search><sort><creationdate>20161128</creationdate><title>Three-dimensional sound-field visualization system using head mounted display and stereo camera</title><author>Inoue, Atsuto ; Ikeda, Yusuke ; Yatabe, Kohei ; Oikawa, Yasuhiro</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c2811-68048d3d0f3821e6cc85c2be083cb5805fad496894a0dc1afcdfbf06f8415cb33</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2016</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Inoue, Atsuto</creatorcontrib><creatorcontrib>Ikeda, Yusuke</creatorcontrib><creatorcontrib>Yatabe, Kohei</creatorcontrib><creatorcontrib>Oikawa, Yasuhiro</creatorcontrib></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Inoue, Atsuto</au><au>Ikeda, Yusuke</au><au>Yatabe, Kohei</au><au>Oikawa, Yasuhiro</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>Three-dimensional sound-field visualization system using head mounted display and stereo camera</atitle><btitle>Proceedings of Meetings on Acoustics</btitle><date>2016-11-28</date><risdate>2016</risdate><volume>29</volume><issue>1</issue><eissn>1939-800X</eissn><coden>PMARCW</coden><abstract>Visualization of a sound field helps us to intuitively understand various acoustic phenomena in sound design and education. The most straightforward method is to overlap the measured data onto a photographic image. However, in order to understand an entire three-dimensional (3D) sound field by using a conventional two-dimensional screen, it is necessary to move a camera and measure repeatedly. On the other hand, the augmented reality (AR) techniques such as an video see-through head mounted display (VST-HMD) have been rapidly developed. In this study, we propose a sound field visualization system using an VST-HMD and a hand held four-point microphone. This system calculates sound intensity from the four sound signals in real time. Then, the sound intensity distribution is depicted as arrows in the 3D display. The position and angle of the microphones and users head are acquired via AR markers and head tracking sensors of the VST-HMD. The system realizes simple and effective visualization of 3D sound field information from the various directions and positions of view. For the experiments, the sound fields generated by loudspeakers and motorcycles were visualized. The results suggested that the proposed system can present information of the field in easily recognizable manner.</abstract><doi>10.1121/2.0000381</doi><tpages>13</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier EISSN: 1939-800X
ispartof Proceedings of Meetings on Acoustics, 2016, Vol.29 (1)
issn 1939-800X
language eng
recordid cdi_scitation_primary_10_1121_2_0000381
source AIP Open Access Journals
title Three-dimensional sound-field visualization system using head mounted display and stereo camera
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-09-22T05%3A34%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-scitation_AJDQP&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=Three-dimensional%20sound-field%20visualization%20system%20using%20head%20mounted%20display%20and%20stereo%20camera&rft.btitle=Proceedings%20of%20Meetings%20on%20Acoustics&rft.au=Inoue,%20Atsuto&rft.date=2016-11-28&rft.volume=29&rft.issue=1&rft.eissn=1939-800X&rft.coden=PMARCW&rft_id=info:doi/10.1121/2.0000381&rft_dat=%3Cscitation_AJDQP%3Epoma%3C/scitation_AJDQP%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c2811-68048d3d0f3821e6cc85c2be083cb5805fad496894a0dc1afcdfbf06f8415cb33%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true