Semi-Automated Excavation System for Partially Buried Objects Using Stereo Vision-Based Three-Dimensional Localization

Authors: Maruyama, Kenichi1; Takase, Ryuichi2; Kawai, Yoshihiro2; Yoshimi, Takashi2; Takahashi, Hironobu3; Tomita, Fumiaki2

Source: Advanced Robotics, Volume 24, Numbers 5-6, 2010 , pp. 651-670(20)

Publisher: Taylor and Francis Ltd

Buy & download fulltext article:


Price: $61.16 plus tax (Refund Policy)


We present a semi-automated excavation system for partially buried objects in unstructured environments. This system is a prototype of an excavation system for abandoned chemical weapons. It integrates three-dimensional (3-D) sensing by a stereo camera system, 3-D object localization, verification by a human operator and robot manipulation. The 3-D object localization method used consists of three steps. (i) Candidate regions are extracted from a range image obtained by an area-based stereo-matching method. (ii) For each region, multiple hypotheses for the position and orientation are generated for each object model. (iii) Each hypothesis is verified and improved by an iterative method. The operator verifies the object localization results and then selects one of the objects as the best object that is suitable for grasping by the robot. The robot grasps objects based on the object localization result. Experiments demonstrate the effectiveness of the proposed excavation system in various unstructured environments, which include objects that are partially buried, inclined, overlapping each other and that have been sprinkled with water.


Document Type: Research Article


Affiliations: 1: National Institute of Advanced Industrial Science and Technology, 1-1-1 Umezono, Tsukuba, Ibaraki 305-8568, Japan;, Email: 2: National Institute of Advanced Industrial Science and Technology, 1-1-1 Umezono, Tsukuba, Ibaraki 305-8568, Japan 3: Applied Vision Systems Corp., Tsukuba City Industrial Promotion Center 205, 2-5-1 Azuma, Tsukuba, Ibaraki 305-0031, Japan

Publication date: April 1, 2010


Free Content
Free content
New Content
New content
Open Access Content
Open access content
Subscribed Content
Subscribed content
Free Trial Content
Free trial content

Text size:

A | A | A | A
Share this item with others: These icons link to social bookmarking sites where readers can share and discover new web pages. print icon Print this page