IngentaConnect Acquisition of joint attention through natural interaction utiliz...

Authors: Sumioka, Hidenobu¹; Hosoda, Koh²; Yoshikawa, Yuichiro³; Asada, Minoru²

Source: Advanced Robotics, Volume 21, Number 9, 2007 , pp. 983-999(17)

Abstract:

Joint attention is one of the most important cognitive functions for the emergence of communication not only between humans, but also between humans and robots. In previous work, we have demonstrated how a robot can acquire primary joint attention behavior (gaze following) without external evaluation. However, this method needs the human to tell the robot when to shift its gaze. This paper presents a method that does not need such a constraint by introducing an attention selector based on a measure consisting of saliencies of object features and motion cues. In order to realize natural interaction, a self-organizing map for real-time face pattern separation and contingency learning for gaze following without external evaluation are utilized. The attention selector controls the robot gaze to switch often from the human face to an object and vice versa, and pairs of a face pattern and a gaze motor command are input to the contingency learning. The motion cues are expected to reduce the number of incorrect training data pairs due to the asynchronous interaction that affects the convergence of the contingency learning. The experimental result shows that gaze shift utilizing motion cues enables a robot to synchronize its own motion with human motion and to learn joint attention efficiently in about 20 min.

Keywords: JOINT ATTENTION; MOTION CUES; REAL-TIME LEARNING; ASYNCHRONY; BOOTSTRAP LEARNING

Document Type: Research article

DOI: 10.1163/156855307781035637

Affiliations: 1: Department of Adaptive Machine Systems, Graduate School of Engineering, Osaka University, 2-1 Yamadaoka, Suita, Osaka 565-0871, Japan 2: Department of Adaptive Machine Systems, Graduate School of Engineering, Osaka University, 2-1 Yamadaoka, Suita, Osaka 565-0871, Japan; ERATO, JST, 2-1 Yamadaoka, Suita, Osaka 565-0871, Japan 3: ERATO, JST, 2-1 Yamadaoka, Suita, Osaka 565-0871, Japan

The full text electronic article is available for purchase. You will be able to download the full text electronic article after payment.

$25.00 plus tax Refund Policy

Acquisition of joint attention through natural interaction utilizing motion cues