IngentaConnect Data Processing Algorithms for Generating Textured 3D Building Fa...

Authors: Frueh, Christian¹; Jain, Siddharth²; Zakhor, Avideh³

Source: International Journal of Computer Vision, Volume 61, Number 2, February 2005 , pp. 159-184(26)

Publisher: Springer

Abstract:

In this paper, we develop a set of data processing algorithms for generating textured facade meshes of cities from a series of vertical 2D surface scans and camera images, obtained by a laser scanner and digital camera while driving on public roads under normal traffic conditions. These processing steps are needed to cope with imperfections and non-idealities inherent in laser scanning systems such as occlusions and reflections from glass surfaces. The data is divided into easy-to-handle quasi-linear segments corresponding to approximately straight driving direction and sequential topological order of vertical laser scans; each segment is then transformed into a depth image. Dominant building structures are detected in the depth images, and points are classified into foreground and background layers. Large holes in the background layer, caused by occlusion from foreground layer objects, are filled in by planar or horizontal interpolation. The depth image is further processed by removing isolated points and filling remaining small holes. The foreground objects also leave holes in the texture of building facades, which are filled by horizontal and vertical interpolation in low frequency regions, or by a copy-paste method otherwise. We apply the above steps to a large set of data of downtown Berkeley with several million 3D points, in order to obtain texture-mapped 3D models.

Keywords: 3D city model; occlusion; hole filling; image restoration; texture synthesis; urban simulation

Document Type: Research article

DOI: 10.1023/B:VISI.0000043756.03810.dd

Affiliations: 1: Video and Image Processing Laboratory, Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, USA, Email: frueh@eecs.berkeley.edu 2: Video and Image Processing Laboratory, Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, USA, Email: morpheus@eecs.berkeley.edu 3: Video and Image Processing Laboratory, Department of Electrical Engineering and Computer Sciences, University of California, Berkeley, USA, Email: avz@eecs.berkeley.edu

The full text electronic article is available for purchase. You will be able to download the full text electronic article after payment.

$47.00 plus tax Refund Policy

Data Processing Algorithms for Generating Textured 3D Building Facade Meshes from Laser Scans and Camera Images