Learning to transfer optimal navigation policies

Authors: Kersting, Kristian1; Plagemann, Christian2; Cocora, Alexandru1; Burgard, Wolfram3; De Raedt, Luc4

Source: Advanced Robotics, Volume 21, Number 13, 2007 , pp. 1565-1582(18)

Publisher: VSP, an imprint of Brill

Buy & download fulltext article:

OR

Price: $35.00 plus tax (Refund Policy)

Abstract:

Autonomous agents that act in the real world utilizing sensory input greatly rely on the ability to plan their actions and to transfer these skills across tasks. The majority of path-planning approaches for mobile robots, however, solve the current navigation problem from scratch, given the current and goal configuration of the robot. Consequently, these approaches yield highly efficient plans for the specific situation, but the computed policies typically do not transfer to other, similar tasks. In this paper, we propose to apply techniques from statistical relational learning to the path-planning problem. More precisely, we propose to learn relational decision trees as abstract navigation strategies from example paths. Relational abstraction has several interesting and important properties. First, it allows a mobile robot to imitate navigation behavior shown by users or by optimal policies. Second, it yields comprehensible models of behavior. Finally, a navigation policy learned in one environment naturally transfers to unknown environments. In several experiments with real robots and in simulated runs, we demonstrate that our approach yields efficient navigation plans. We show that our system is robust against observation noise and can outperform hand-crafted policies.

Keywords: STATISTICAL RELATIONAL LEARNING; MOBILE ROBOTICS; NAVIGATION; IMITATION; PATH PLANNING

Document Type: Research article

DOI: http://dx.doi.org/10.1163/156855307782148541

Affiliations: 1: Machine Learning Laboratory, Institute for Computer Science, University of Freiburg, Georges-Koehler-Allee, 79110 Freiburg, Germany 2: Autonomous Intelligent Systems Group, Institute for Computer Science, University of Freiburg, Georges-Koehler-Allee, Building 079, 79110 Freiburg, Germany;, Email: plagem@informatik.uni-freiburg.de 3: Autonomous Intelligent Systems Group, Institute for Computer Science, University of Freiburg, Georges-Koehler-Allee, Building 079, 79110 Freiburg, Germany 4: Machine Learning Laboratory, Institute for Computer Science, University of Freiburg, Georges-Koehler-Allee, 79110 Freiburg, Germany, Department of Computer Science, Katholieke Universiteit Leuven, Celestynenlaan 200A, B-3001 Leuven, Belgium

Publication date: 2007-09-01

Related content

Tools

Key

Free Content
Free content
New Content
New content
Open Access Content
Open access content
Subscribed Content
Subscribed content
Free Trial Content
Free trial content

Text size:

A | A | A | A
Share this item with others: These icons link to social bookmarking sites where readers can share and discover new web pages. print icon Print this page