The Vibe: A Versatile Vision-to-Audition Sensory Substitution Device
We describe a sensory substitution scheme that converts a video stream into an audio stream in real-time. It was initially developed as a research tool for studying human ability to learn new ways of perceiving the world: the Vibe can give us the ability to learn a kind of ‘vision’ by audition. It c...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2010-01-01
|
| Series: | Applied Bionics and Biomechanics |
| Online Access: | http://dx.doi.org/10.1080/11762322.2010.512734 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849308029024993280 |
|---|---|
| author | Sylvain Hanneton Malika Auvray Barthélemy Durette |
| author_facet | Sylvain Hanneton Malika Auvray Barthélemy Durette |
| author_sort | Sylvain Hanneton |
| collection | DOAJ |
| description | We describe a sensory substitution scheme that converts a video stream into an audio stream in real-time. It was initially developed as a research tool for studying human ability to learn new ways of perceiving the world: the Vibe can give us the ability to learn a kind of ‘vision’ by audition. It converts a video stream into a continuous stereophonic audio signal that conveys information coded from the video stream. The conversion from the video stream to the audio stream uses a kind of retina with receptive fields. Each receptive field controls a sound source and the user listens to a sound that is a mixture of all these sound sources. Compared to other existing vision-to-audition sensory substitution devices, the Vibe is highly versatile in particular because it uses a set of configurable units working in parallel. In order to demonstrate the validity and interest of this method of vision to audition conversion, we give the results of an experiment involving a pointing task to targets memorised through visual perception or through their auditory conversion by the Vibe. This article is also an opportunity to precisely draw the general specifications of this scheme in order to prepare its implementation on an autonomous/mobile hardware. |
| format | Article |
| id | doaj-art-16e4f4e8c9bd400f92d0b755d8ca80a3 |
| institution | Kabale University |
| issn | 1176-2322 1754-2103 |
| language | English |
| publishDate | 2010-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Applied Bionics and Biomechanics |
| spelling | doaj-art-16e4f4e8c9bd400f92d0b755d8ca80a32025-08-20T03:54:33ZengWileyApplied Bionics and Biomechanics1176-23221754-21032010-01-017426927610.1080/11762322.2010.512734The Vibe: A Versatile Vision-to-Audition Sensory Substitution DeviceSylvain Hanneton0Malika Auvray1Barthélemy Durette2Laboratoire de Neurophysique et Physiologie UMR CNRS 8119 Universit Paris Descartes, Paris, FranceLIMSI-CNRS (CPU team), Bâtiments 508 et 502bis, Université de Paris-Sud, 91403 ORSAY, FranceJustus-Liebig-Universität Gießen, Fachbereich 06, Psychologie und Sportwissenschaft, Abteilung Allgemeine Psychologie, Otto-Behaghel-Strasse 10F, 35394 Giessen, FranceWe describe a sensory substitution scheme that converts a video stream into an audio stream in real-time. It was initially developed as a research tool for studying human ability to learn new ways of perceiving the world: the Vibe can give us the ability to learn a kind of ‘vision’ by audition. It converts a video stream into a continuous stereophonic audio signal that conveys information coded from the video stream. The conversion from the video stream to the audio stream uses a kind of retina with receptive fields. Each receptive field controls a sound source and the user listens to a sound that is a mixture of all these sound sources. Compared to other existing vision-to-audition sensory substitution devices, the Vibe is highly versatile in particular because it uses a set of configurable units working in parallel. In order to demonstrate the validity and interest of this method of vision to audition conversion, we give the results of an experiment involving a pointing task to targets memorised through visual perception or through their auditory conversion by the Vibe. This article is also an opportunity to precisely draw the general specifications of this scheme in order to prepare its implementation on an autonomous/mobile hardware.http://dx.doi.org/10.1080/11762322.2010.512734 |
| spellingShingle | Sylvain Hanneton Malika Auvray Barthélemy Durette The Vibe: A Versatile Vision-to-Audition Sensory Substitution Device Applied Bionics and Biomechanics |
| title | The Vibe: A Versatile Vision-to-Audition Sensory Substitution Device |
| title_full | The Vibe: A Versatile Vision-to-Audition Sensory Substitution Device |
| title_fullStr | The Vibe: A Versatile Vision-to-Audition Sensory Substitution Device |
| title_full_unstemmed | The Vibe: A Versatile Vision-to-Audition Sensory Substitution Device |
| title_short | The Vibe: A Versatile Vision-to-Audition Sensory Substitution Device |
| title_sort | vibe a versatile vision to audition sensory substitution device |
| url | http://dx.doi.org/10.1080/11762322.2010.512734 |
| work_keys_str_mv | AT sylvainhanneton thevibeaversatilevisiontoauditionsensorysubstitutiondevice AT malikaauvray thevibeaversatilevisiontoauditionsensorysubstitutiondevice AT barthelemydurette thevibeaversatilevisiontoauditionsensorysubstitutiondevice AT sylvainhanneton vibeaversatilevisiontoauditionsensorysubstitutiondevice AT malikaauvray vibeaversatilevisiontoauditionsensorysubstitutiondevice AT barthelemydurette vibeaversatilevisiontoauditionsensorysubstitutiondevice |