Binaural Active Audition for Humanoid Robots to Localise Speech over Entire Azimuth Range
We applied motion theory to robot audition to improve the inadequate performance. Motions are critical for overcoming the ambiguity and sparseness of information obtained by two microphones. To realise this, we first designed a sound source localisation system integrated with cross-power spectrum ph...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Wiley
2009-01-01
|
| Series: | Applied Bionics and Biomechanics |
| Online Access: | http://dx.doi.org/10.1080/11762320903007430 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832558962314051584 |
|---|---|
| author | Hyun-Don Kim Kazunori Komatani Tetsuya Ogata Hiroshi G. Okuno |
| author_facet | Hyun-Don Kim Kazunori Komatani Tetsuya Ogata Hiroshi G. Okuno |
| author_sort | Hyun-Don Kim |
| collection | DOAJ |
| description | We applied motion theory to robot audition to improve the inadequate performance. Motions are critical for overcoming the ambiguity and sparseness of information obtained by two microphones. To realise this, we first designed a sound source localisation system integrated with cross-power spectrum phase (CSP) analysis and an EM algorithm. The CSP of sound signals obtained with only two microphones was used to localise the sound source without having to measure impulse response data. The expectation-maximisation (EM) algorithm helped the system to cope with several moving sound sources and reduce localisation errors. We then proposed a way of constructing a database for moving sounds to evaluate binaural sound source localisation. We evaluated our sound localisation method using artificial moving sounds and confirmed that it could effectively localise moving sounds slower than 1.125 rad/s. Consequently, we solved the problem of distinguishing whether sounds were coming from the front or rear by rotating and/or tipping the robot's head that was equipped with only two microphones. Our system was applied to a humanoid robot called SIG2, and we confirmed its ability to localise sounds over the entire azimuth range as the success rates for sound localisation in the front and rear areas were 97.6% and 75.6% respectively. |
| format | Article |
| id | doaj-art-cfdbe02d18ad4a4b9ed1eba6cf1e319f |
| institution | Kabale University |
| issn | 1176-2322 1754-2103 |
| language | English |
| publishDate | 2009-01-01 |
| publisher | Wiley |
| record_format | Article |
| series | Applied Bionics and Biomechanics |
| spelling | doaj-art-cfdbe02d18ad4a4b9ed1eba6cf1e319f2025-02-03T01:31:17ZengWileyApplied Bionics and Biomechanics1176-23221754-21032009-01-0163-435536710.1080/11762320903007430Binaural Active Audition for Humanoid Robots to Localise Speech over Entire Azimuth RangeHyun-Don Kim0Kazunori Komatani1Tetsuya Ogata2Hiroshi G. Okuno3Department of Intelligence Science and Technology, Graduate School of Informatics, Kyoto University, Yoshida-honmachi, Kyoto, JapanDepartment of Intelligence Science and Technology, Graduate School of Informatics, Kyoto University, Yoshida-honmachi, Kyoto, JapanDepartment of Intelligence Science and Technology, Graduate School of Informatics, Kyoto University, Yoshida-honmachi, Kyoto, JapanDepartment of Intelligence Science and Technology, Graduate School of Informatics, Kyoto University, Yoshida-honmachi, Kyoto, JapanWe applied motion theory to robot audition to improve the inadequate performance. Motions are critical for overcoming the ambiguity and sparseness of information obtained by two microphones. To realise this, we first designed a sound source localisation system integrated with cross-power spectrum phase (CSP) analysis and an EM algorithm. The CSP of sound signals obtained with only two microphones was used to localise the sound source without having to measure impulse response data. The expectation-maximisation (EM) algorithm helped the system to cope with several moving sound sources and reduce localisation errors. We then proposed a way of constructing a database for moving sounds to evaluate binaural sound source localisation. We evaluated our sound localisation method using artificial moving sounds and confirmed that it could effectively localise moving sounds slower than 1.125 rad/s. Consequently, we solved the problem of distinguishing whether sounds were coming from the front or rear by rotating and/or tipping the robot's head that was equipped with only two microphones. Our system was applied to a humanoid robot called SIG2, and we confirmed its ability to localise sounds over the entire azimuth range as the success rates for sound localisation in the front and rear areas were 97.6% and 75.6% respectively.http://dx.doi.org/10.1080/11762320903007430 |
| spellingShingle | Hyun-Don Kim Kazunori Komatani Tetsuya Ogata Hiroshi G. Okuno Binaural Active Audition for Humanoid Robots to Localise Speech over Entire Azimuth Range Applied Bionics and Biomechanics |
| title | Binaural Active Audition for Humanoid Robots to Localise Speech over Entire Azimuth Range |
| title_full | Binaural Active Audition for Humanoid Robots to Localise Speech over Entire Azimuth Range |
| title_fullStr | Binaural Active Audition for Humanoid Robots to Localise Speech over Entire Azimuth Range |
| title_full_unstemmed | Binaural Active Audition for Humanoid Robots to Localise Speech over Entire Azimuth Range |
| title_short | Binaural Active Audition for Humanoid Robots to Localise Speech over Entire Azimuth Range |
| title_sort | binaural active audition for humanoid robots to localise speech over entire azimuth range |
| url | http://dx.doi.org/10.1080/11762320903007430 |
| work_keys_str_mv | AT hyundonkim binauralactiveauditionforhumanoidrobotstolocalisespeechoverentireazimuthrange AT kazunorikomatani binauralactiveauditionforhumanoidrobotstolocalisespeechoverentireazimuthrange AT tetsuyaogata binauralactiveauditionforhumanoidrobotstolocalisespeechoverentireazimuthrange AT hiroshigokuno binauralactiveauditionforhumanoidrobotstolocalisespeechoverentireazimuthrange |