Learning to Perceive with a Visuo — Auditory Substitution System: Localisation and Object Recognition with ‘The Voice’

We investigated to what extent participants can acquire the mastery of an auditory-substitution-of-vision device (‘The vOICe’) using dynamic tasks in a three-dimensional environment. After extensive training, participants took part in four experiments. In the first experiment we explored locomotion...

Full description

Saved in:
Bibliographic Details
Published in:Perception (London) 2007-01, Vol.36 (3), p.416-430
Main Authors: Auvray, Malika, Hanneton, Sylvain, O'Regan, J Kevin
Format: Article
Language:English
Subjects:
Adult
Auditory Perception
Discrimination (Psychology)
Female
Fingers
Humans
Learning
Life Sciences
Male
Motor Activity
Neurons and Cognition
Perception
Physical Stimulation
Physical Stimulation - methods
Psychomotor Performance
Reaction Time
Recognition (Psychology)
Self Assessment (Psychology)
Self-Assessment
Walking
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
cited_by cdi_FETCH-LOGICAL-c336t-ddbadd0098b0a214d767bbb8ed384718af3da41c11f5c4b3cac0973ea44e9be03
cites cdi_FETCH-LOGICAL-c336t-ddbadd0098b0a214d767bbb8ed384718af3da41c11f5c4b3cac0973ea44e9be03
container_end_page 430
container_issue 3
container_start_page 416
container_title Perception (London)
container_volume 36
creator Auvray, Malika
Hanneton, Sylvain
O'Regan, J Kevin
description We investigated to what extent participants can acquire the mastery of an auditory-substitution-of-vision device (‘The vOICe’) using dynamic tasks in a three-dimensional environment. After extensive training, participants took part in four experiments. In the first experiment we explored locomotion and localisation abilities. Participants, blindfolded and equipped with the device, had to localise a target by moving a hand-held camera, walk towards the target, and point at it. In the second experiment, we studied the localisation ability in a constrained pointing task. In the third experiment we explored participants' ability to recognise natural objects via their auditory rendering. In the fourth experiment we tested the ability of participants to discriminate objects belonging to the same category. We analysed participants' performance from both an objective and a subjective point of view. The results showed that participants, through sensorimotor interactions with the perceptual scene while using the hand-held camera, were able to make use of the auditory stimulation to obtain the information necessary for locomotor guidance, localisation, and pointing, as well as for object recognition. Furthermore, analysis from a subjective perspective yielded insights into participants' qualitative experience and into the strategies they used to master the device, and thus to pass from a kind of deductive reasoning to a form of immediate apprehension of what is being perceived.
doi_str_mv 10.1068/p5631
format article
fullrecord <record><control><sourceid>proquest_hal_p</sourceid><recordid>TN_cdi_hal_primary_oai_HAL_hal_00173589v1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sage_id>10.1068_p5631</sage_id><sourcerecordid>70423149</sourcerecordid><originalsourceid>FETCH-LOGICAL-c336t-ddbadd0098b0a214d767bbb8ed384718af3da41c11f5c4b3cac0973ea44e9be03</originalsourceid><addsrcrecordid>eNpdkc1qGzEUhUVJadw0rxBEIIEuppUizV93JqRNYSClSbMVV9K1LTMeOZImwdCFH6KL9vX8JJ3YJoWuDhw-vsU5hBxz9oGzovq4zAvBX5ERl0WVyQshDsiICcYzxorikLyNcc4Yl3Uu3pBDXso8L_NiRH42CKFz3ZQmT79hMOgekT65NKNA713sPd2sf9Fxb13yYUVvex2TS31yvqO3q5hw8Yk23kDrImxL6Cy90XM0iX5H46ed29Zb5Wb9-26G9N47g5v1n3fk9QTaiMf7PCI_Pl_dXV5nzc2Xr5fjJjNCFCmzVoO1jNWVZnDBpS2LUmtdoRWVLHkFE2FBcsP5JDdSCwOG1aVAkBJrjUwckfc77wxatQxuAWGlPDh1PW7UczcsU4q8qh_5wJ7v2GXwDz3GpBYuGmxb6ND3UZVsGHfYcQDPdqAJPsaAkxczZ-r5ErW9ZOBO9sJeL9D-o_YfDMDpDogwRTX3feiGMf6z_AVIDJSJ</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>70423149</pqid></control><display><type>article</type><title>Learning to Perceive with a Visuo — Auditory Substitution System: Localisation and Object Recognition with ‘The Voice’</title><source>SAGE</source><creator>Auvray, Malika ; Hanneton, Sylvain ; O'Regan, J Kevin</creator><creatorcontrib>Auvray, Malika ; Hanneton, Sylvain ; O'Regan, J Kevin</creatorcontrib><description>We investigated to what extent participants can acquire the mastery of an auditory-substitution-of-vision device (‘The vOICe’) using dynamic tasks in a three-dimensional environment. After extensive training, participants took part in four experiments. In the first experiment we explored locomotion and localisation abilities. Participants, blindfolded and equipped with the device, had to localise a target by moving a hand-held camera, walk towards the target, and point at it. In the second experiment, we studied the localisation ability in a constrained pointing task. In the third experiment we explored participants' ability to recognise natural objects via their auditory rendering. In the fourth experiment we tested the ability of participants to discriminate objects belonging to the same category. We analysed participants' performance from both an objective and a subjective point of view. The results showed that participants, through sensorimotor interactions with the perceptual scene while using the hand-held camera, were able to make use of the auditory stimulation to obtain the information necessary for locomotor guidance, localisation, and pointing, as well as for object recognition. Furthermore, analysis from a subjective perspective yielded insights into participants' qualitative experience and into the strategies they used to master the device, and thus to pass from a kind of deductive reasoning to a form of immediate apprehension of what is being perceived.</description><identifier>ISSN: 0301-0066</identifier><identifier>EISSN: 1468-4233</identifier><identifier>DOI: 10.1068/p5631</identifier><identifier>PMID: 17455756</identifier><language>eng</language><publisher>London, England: SAGE Publications</publisher><subject>Adult ; Auditory Perception ; Discrimination (Psychology) ; Female ; Fingers ; Humans ; Learning ; Life Sciences ; Male ; Motor Activity ; Neurons and Cognition ; Perception ; Physical Stimulation ; Physical Stimulation - methods ; Psychomotor Performance ; Reaction Time ; Recognition (Psychology) ; Self Assessment (Psychology) ; Self-Assessment ; Walking</subject><ispartof>Perception (London), 2007-01, Vol.36 (3), p.416-430</ispartof><rights>2007 SAGE Publications</rights><rights>Distributed under a Creative Commons Attribution 4.0 International License</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c336t-ddbadd0098b0a214d767bbb8ed384718af3da41c11f5c4b3cac0973ea44e9be03</citedby><cites>FETCH-LOGICAL-c336t-ddbadd0098b0a214d767bbb8ed384718af3da41c11f5c4b3cac0973ea44e9be03</cites><orcidid>0000-0002-4173-8146 ; 0000-0002-1338-1856</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,315,786,790,891,27957,27958</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/17455756$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink><backlink>$$Uhttps://hal.science/hal-00173589$$DView record in HAL$$Hfree_for_read</backlink></links><search><creatorcontrib>Auvray, Malika</creatorcontrib><creatorcontrib>Hanneton, Sylvain</creatorcontrib><creatorcontrib>O'Regan, J Kevin</creatorcontrib><title>Learning to Perceive with a Visuo — Auditory Substitution System: Localisation and Object Recognition with ‘The Voice’</title><title>Perception (London)</title><addtitle>Perception</addtitle><description>We investigated to what extent participants can acquire the mastery of an auditory-substitution-of-vision device (‘The vOICe’) using dynamic tasks in a three-dimensional environment. After extensive training, participants took part in four experiments. In the first experiment we explored locomotion and localisation abilities. Participants, blindfolded and equipped with the device, had to localise a target by moving a hand-held camera, walk towards the target, and point at it. In the second experiment, we studied the localisation ability in a constrained pointing task. In the third experiment we explored participants' ability to recognise natural objects via their auditory rendering. In the fourth experiment we tested the ability of participants to discriminate objects belonging to the same category. We analysed participants' performance from both an objective and a subjective point of view. The results showed that participants, through sensorimotor interactions with the perceptual scene while using the hand-held camera, were able to make use of the auditory stimulation to obtain the information necessary for locomotor guidance, localisation, and pointing, as well as for object recognition. Furthermore, analysis from a subjective perspective yielded insights into participants' qualitative experience and into the strategies they used to master the device, and thus to pass from a kind of deductive reasoning to a form of immediate apprehension of what is being perceived.</description><subject>Adult</subject><subject>Auditory Perception</subject><subject>Discrimination (Psychology)</subject><subject>Female</subject><subject>Fingers</subject><subject>Humans</subject><subject>Learning</subject><subject>Life Sciences</subject><subject>Male</subject><subject>Motor Activity</subject><subject>Neurons and Cognition</subject><subject>Perception</subject><subject>Physical Stimulation</subject><subject>Physical Stimulation - methods</subject><subject>Psychomotor Performance</subject><subject>Reaction Time</subject><subject>Recognition (Psychology)</subject><subject>Self Assessment (Psychology)</subject><subject>Self-Assessment</subject><subject>Walking</subject><issn>0301-0066</issn><issn>1468-4233</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2007</creationdate><recordtype>article</recordtype><recordid>eNpdkc1qGzEUhUVJadw0rxBEIIEuppUizV93JqRNYSClSbMVV9K1LTMeOZImwdCFH6KL9vX8JJ3YJoWuDhw-vsU5hBxz9oGzovq4zAvBX5ERl0WVyQshDsiICcYzxorikLyNcc4Yl3Uu3pBDXso8L_NiRH42CKFz3ZQmT79hMOgekT65NKNA713sPd2sf9Fxb13yYUVvex2TS31yvqO3q5hw8Yk23kDrImxL6Cy90XM0iX5H46ed29Zb5Wb9-26G9N47g5v1n3fk9QTaiMf7PCI_Pl_dXV5nzc2Xr5fjJjNCFCmzVoO1jNWVZnDBpS2LUmtdoRWVLHkFE2FBcsP5JDdSCwOG1aVAkBJrjUwckfc77wxatQxuAWGlPDh1PW7UczcsU4q8qh_5wJ7v2GXwDz3GpBYuGmxb6ND3UZVsGHfYcQDPdqAJPsaAkxczZ-r5ErW9ZOBO9sJeL9D-o_YfDMDpDogwRTX3feiGMf6z_AVIDJSJ</recordid><startdate>20070101</startdate><enddate>20070101</enddate><creator>Auvray, Malika</creator><creator>Hanneton, Sylvain</creator><creator>O'Regan, J Kevin</creator><general>SAGE Publications</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><scope>1XC</scope><orcidid>https://orcid.org/0000-0002-4173-8146</orcidid><orcidid>https://orcid.org/0000-0002-1338-1856</orcidid></search><sort><creationdate>20070101</creationdate><title>Learning to Perceive with a Visuo — Auditory Substitution System: Localisation and Object Recognition with ‘The Voice’</title><author>Auvray, Malika ; Hanneton, Sylvain ; O'Regan, J Kevin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c336t-ddbadd0098b0a214d767bbb8ed384718af3da41c11f5c4b3cac0973ea44e9be03</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2007</creationdate><topic>Adult</topic><topic>Auditory Perception</topic><topic>Discrimination (Psychology)</topic><topic>Female</topic><topic>Fingers</topic><topic>Humans</topic><topic>Learning</topic><topic>Life Sciences</topic><topic>Male</topic><topic>Motor Activity</topic><topic>Neurons and Cognition</topic><topic>Perception</topic><topic>Physical Stimulation</topic><topic>Physical Stimulation - methods</topic><topic>Psychomotor Performance</topic><topic>Reaction Time</topic><topic>Recognition (Psychology)</topic><topic>Self Assessment (Psychology)</topic><topic>Self-Assessment</topic><topic>Walking</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Auvray, Malika</creatorcontrib><creatorcontrib>Hanneton, Sylvain</creatorcontrib><creatorcontrib>O'Regan, J Kevin</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><collection>Hyper Article en Ligne (HAL)</collection><jtitle>Perception (London)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Auvray, Malika</au><au>Hanneton, Sylvain</au><au>O'Regan, J Kevin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Learning to Perceive with a Visuo — Auditory Substitution System: Localisation and Object Recognition with ‘The Voice’</atitle><jtitle>Perception (London)</jtitle><addtitle>Perception</addtitle><date>2007-01-01</date><risdate>2007</risdate><volume>36</volume><issue>3</issue><spage>416</spage><epage>430</epage><pages>416-430</pages><issn>0301-0066</issn><eissn>1468-4233</eissn><notes>ObjectType-Article-1</notes><notes>SourceType-Scholarly Journals-1</notes><notes>ObjectType-Feature-2</notes><notes>content type line 23</notes><abstract>We investigated to what extent participants can acquire the mastery of an auditory-substitution-of-vision device (‘The vOICe’) using dynamic tasks in a three-dimensional environment. After extensive training, participants took part in four experiments. In the first experiment we explored locomotion and localisation abilities. Participants, blindfolded and equipped with the device, had to localise a target by moving a hand-held camera, walk towards the target, and point at it. In the second experiment, we studied the localisation ability in a constrained pointing task. In the third experiment we explored participants' ability to recognise natural objects via their auditory rendering. In the fourth experiment we tested the ability of participants to discriminate objects belonging to the same category. We analysed participants' performance from both an objective and a subjective point of view. The results showed that participants, through sensorimotor interactions with the perceptual scene while using the hand-held camera, were able to make use of the auditory stimulation to obtain the information necessary for locomotor guidance, localisation, and pointing, as well as for object recognition. Furthermore, analysis from a subjective perspective yielded insights into participants' qualitative experience and into the strategies they used to master the device, and thus to pass from a kind of deductive reasoning to a form of immediate apprehension of what is being perceived.</abstract><cop>London, England</cop><pub>SAGE Publications</pub><pmid>17455756</pmid><doi>10.1068/p5631</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0002-4173-8146</orcidid><orcidid>https://orcid.org/0000-0002-1338-1856</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0301-0066
ispartof Perception (London), 2007-01, Vol.36 (3), p.416-430
issn 0301-0066
1468-4233
language eng
recordid cdi_hal_primary_oai_HAL_hal_00173589v1
source SAGE
subjects Adult
Auditory Perception
Discrimination (Psychology)
Female
Fingers
Humans
Learning
Life Sciences
Male
Motor Activity
Neurons and Cognition
Perception
Physical Stimulation
Physical Stimulation - methods
Psychomotor Performance
Reaction Time
Recognition (Psychology)
Self Assessment (Psychology)
Self-Assessment
Walking
title Learning to Perceive with a Visuo — Auditory Substitution System: Localisation and Object Recognition with ‘The Voice’
url http://sfxeu10.hosted.exlibrisgroup.com/loughborough?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-09-22T16%3A23%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_hal_p&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Learning%20to%20Perceive%20with%20a%20Visuo%20%E2%80%94%20Auditory%20Substitution%20System:%20Localisation%20and%20Object%20Recognition%20with%20%E2%80%98The%20Voice%E2%80%99&rft.jtitle=Perception%20(London)&rft.au=Auvray,%20Malika&rft.date=2007-01-01&rft.volume=36&rft.issue=3&rft.spage=416&rft.epage=430&rft.pages=416-430&rft.issn=0301-0066&rft.eissn=1468-4233&rft_id=info:doi/10.1068/p5631&rft_dat=%3Cproquest_hal_p%3E70423149%3C/proquest_hal_p%3E%3Cgrp_id%3Ecdi_FETCH-LOGICAL-c336t-ddbadd0098b0a214d767bbb8ed384718af3da41c11f5c4b3cac0973ea44e9be03%3C/grp_id%3E%3Coa%3E%3C/oa%3E%3Curl%3E%3C/url%3E&rft_id=info:oai/&rft_pqid=70423149&rft_id=info:pmid/17455756&rft_sage_id=10.1068_p5631&rfr_iscdi=true