Skip to main content

Design and Implementation of Robot Audition System 'HARK' — Open Source Software for Listening to Three Simultaneous Speakers

Buy Article:

$60.90 plus tax (Refund Policy)

Abstract:

This paper presents the design and implementation of the HARK robot audition software system consisting of sound source localization modules, sound source separation modules and automatic speech recognition modules of separated speech signals that works on any robot with any microphone configuration. Since a robot with ears may be deployed to various auditory environments, the robot audition system should provide an easy way to adapt to them. HARK provides a set of modules to cope with various auditory environments by using an open-sourced middleware, FlowDesigner, and reduces the overheads of data transfer between modules. HARK has been open-sourced since April 2008. The resulting implementation of HARK with MUSIC-based sound source localization, GSS-based sound source separation and Missing Feature Theory-based automatic speech recognition on Honda ASIMO, SIG2 and Robovie R2 attains recognizing three simultaneous utterances with the delay of 1.9 s at the word correct rate of 80–90% for three speakers.

Keywords: AUTOMATIC SPEECH RECOGNITION; OPEN SOURCE SOFTWARE; ROBOT AUDITION; SOUND SOURCE LOCALIZATION; SOUND SOURCE SEPARATION

Document Type: Research Article

DOI: http://dx.doi.org/10.1163/016918610X493561

Affiliations: 1: Honda Research Institute Japan Co., Ltd, 8-1 Honcho, Wako-shi, Saitama 351-0114, Japan, Tokyo Insititute of Technology, 2-12-1 Ookayama, Meguro-ku, Tokyo 152-8550, Japan;, Email: nakadai@jp.honda-ri.com 2: Kyoto University, Yoshidahonchou, Sakyou-ku, Kyoto 606-8501, Japan 3: Honda Research Institute Japan Co., Ltd, 8-1 Honcho, Wako-shi, Saitama 351-0114, Japan

Publication date: April 1, 2010

tandf/arb/2010/00000024/F0020005/art00007
dcterms_title,dcterms_description,pub_keyword
6
5
20
40
5

Access Key

Free Content
Free content
New Content
New content
Open Access Content
Open access content
Subscribed Content
Subscribed content
Free Trial Content
Free trial content
Cookie Policy
X
Cookie Policy
Ingenta Connect website makes use of cookies so as to keep track of data that you have filled in. I am Happy with this Find out more