Integrating Recognition and Action Through Task-Relevant Knowledge for Daily Assistive Humanoids

Authors: Okada, Kei1; Kojima, Mitsuharu2; Tokutsu, Satoru2; Mori, Yuto2; Maki, Toshiaki2; Inaba, Masayuki2

Source: Advanced Robotics, Volume 23, Number 4, 2009 , pp. 459-480(22)

Publisher: VSP, an imprint of Brill

Buy & download fulltext article:

OR

Price: $35.00 plus tax (Refund Policy)

Abstract:

This paper describes the design of a humanoid robot system that can perform daily assistive tasks. The significant issue in realizing a daily assistive humanoid robot system is to integrate an action subsystem and a recognition subsystem. We have designed a task-relevant knowledge that referred from both the action and recognition subsystems. The knowledge-based subsystem contains not only the information on an environment and objects' shapes, but also represents manipulation and navigation-related knowledge, and that for object recognition and robot localization. Since motion generation and an object recognition procedure share the same knowledge base system, the robot is capable of planning motion while recognizing objects and vice versa. This capability increases the effectiveness and robustness of the system. Three vision-guided behavior controls are presented during the execution of an action: (i) a visual self-localization to recognize the position of the robot, (ii) a visual object localization to update the object location in the model world to generate behaviors and (iii) a visual behavior verification to confirm the success of the motion. Finally, we demonstrated a kitchen service task by multiple humanoid robots to prove the broad capability and applicability of the proposed representation. The knowledge descriptions required for this demonstration consist of 13 behaviors, six objects with manipulation and visual feature knowledge, three search areas for the recognition process and two task-relevant visual behavior verification knowledge bases. We found that the description required for a kitchen service task is rather simple compared to the complexity of the demo scenario.

Keywords: HUMANOID; ROBOT SYSTEM; VISUAL RECOGNITION; TASK-RELEVANT KNOWLEDGE; DAILY ASSISTIVE TASKS

Document Type: Research article

DOI: http://dx.doi.org/10.1163/156855309X408835

Affiliations: 1: Graduate School of Information Science and Technology, University of Tokyo, 7-3-1, Hongo, Bukyo-ku, Tokyo 131-8656, Japan;, Email: k-okada@jsk.t.u-tokyo.ac.jp 2: Graduate School of Information Science and Technology, University of Tokyo, 7-3-1, Hongo, Bukyo-ku, Tokyo 131-8656, Japan

Publication date: 2009-03-01

Related content

Tools

Key

Free Content
Free content
New Content
New content
Open Access Content
Open access content
Subscribed Content
Subscribed content
Free Trial Content
Free trial content

Text size:

A | A | A | A
Share this item with others: These icons link to social bookmarking sites where readers can share and discover new web pages. print icon Print this page