Person:

Dellaert, Frank

Permanent Link

https://hdl.handle.net/1853/71202

Associated Organization(s)

Organizational Unit

School of Interactive Computing

Full item page

Publication Search Results

Now showing 1 - 10 of 50

Detecting and Matching Repeated Patterns for Automatic Geo-tagging in Urban Environments

(Georgia Institute of Technology, 2008-06) Schindler, Grant ; Krishnamurthy, Panchapagesan ; Lublinerman, Roberto ; Liu, Yanxi ; Dellaert, Frank

We present a novel method for automatically geo-tagging photographs of man-made environments via detection and matching of repeated patterns. Highly repetitive environments introduce numerous correspondence ambiguities and are problematic for traditional wide-baseline matching methods. Our method exploits the highly repetitive nature of urban environments, detecting multiple perspectively distorted periodic 2D patterns in an image and matching them to a 3D database of textured facades by reasoning about the underlying canonical forms of each pattern. Multiple 2D-to-3D pattern correspondences enable robust recovery of camera orientation and location. We demonstrate the success of this method in a large urban environment.
2007 RoboCup International Symposium

(Georgia Institute of Technology, 2008-05) Balch, Tucker ; Dellaert, Frank
Place Recognition-Based Fixed-Lag Smoothing for Environments with Unreliable GPS

(Georgia Institute of Technology, 2008-05) Mottaghi, Roozbeh ; Kaess, Michael ; Ranganathan, Ananth ; Roberts, Richard ; Dellaert, Frank

Pose estimation of outdoor robots presents some distinct challenges due to the various uncertainties in the robot sensing and action. In particular, global positioning sensors of outdoor robots do not always work perfectly, causing large drift in the location estimate of the robot. To overcome this common problem, we propose a new approach for global localization using place recognition. First, we learn the location of some arbitrary key places using odometry measurements and GPS measurements only at the start and the end of the robot trajectory. In subsequent runs, when the robot perceives a key place, our fixed-lag smoother fuses odometry measurements with the relative location to the key place to improve its pose estimate. Outdoor mobile robot experiments show that place recognition measurements significantly improve the estimate of the smoother in the absence of GPS measurements.
Learning and Inferring Motion Patterns Using Parametric Segmental Switching Linear Dynamic Systems

(Georgia Institute of Technology, 2008) Oh, Sang Min ; Rehg, James M. ; Balch, Tucker ; Dellaert, Frank

Switching Linear Dynamic System (SLDS) models are a popular technique for modeling complex nonlinear dynamic systems. An SLDS provides the possibility to describe complex temporal patterns more concisely and accurately than an HMM by using continuous hidden states. However, the use of SLDS models in practical applications is challenging for several reasons. First, exact inference in SLDS models is computationally intractable. Second, the geometric duration model induced in standard SLDSs limits their representational power. Third, standard SLDSs do not provide a systematic way to robustly interpret systematic variations governed by higher order parameters. The contributions in this paper address all three challenges above. First, we present a data-driven MCMC sampling method for SLDSs as a robust and efficient approximate inference method. Second, we present segmental switching linear dynamic systems (S-SLDS), where the geometric distributions are replaced with arbitrary duration models. Third, we extend the standard model with a parametric model that can capture systematic temporal and spatial variations. The resulting parametric SLDS model (P-SLDS) uses EM to robustly interpret parametrized motions by incorporating additional global parameters that underly systematic variations of the overall motion. The overall development of the proposed inference methods and extensions for SLDSs provide a robust framework to interpret complex motions. The framework is applied to the honey bee dance interpretation task in the context of the on-going BioTracking project at Georgia Institute of Technology. The experimental results suggest that the enhanced models provide an effective framework for a wide range of motion analysis applications.
iSAM: Incremental Smoothing and Mapping

(Georgia Institute of Technology, 2008) Kaess, Michael ; Ranganathan, Ananth ; Dellaert, Frank

We present incremental smoothing and mapping (iSAM), a novel approach to the simultaneous localization and mapping problem that is based on fast incremental matrix factorization. iSAM provides an efficient and exact solution by updating a QR factorization of the naturally sparse smoothing information matrix, therefore recalculating only the matrix entries that actually change. iSAM is efficient even for robot trajectories with many loops as it avoids unnecessary fill-in in the factor matrix by periodic variable reordering. Also, to enable data association in real-time, we provide efficient algorithms to access the estimation uncertainties of interest based on the factored information matrix. We systematically evaluate the different components of iSAM as well as the overall algorithm using various simulated and real-world datasets for both landmark and pose-only settings.
Automatic Landmark Detection for Topological Mapping Using Bayesian Surprise

(Georgia Institute of Technology, 2008) Ranganathan, Ananth ; Dellaert, Frank

Topological maps are graphical representations of the environment consisting of nodes that denote landmarks, and edges that represent the connectivity between the landmarks. Automatic detection of landmarks, usually special places in the environment such as gateways, in a general, sensor-independent manner has proven to be a difficult task. We present a landmark detection scheme based on the notion of “surprise” that addresses these issues. The surprise associated with a measurement is defined as the change in the current model upon updating it using the measurement. We demonstrate that surprise is large when sudden changes in the environment occur, and hence, is a good indicator of landmarks. We evaluate our landmark detector using appearance and laser measurements both qualitatively and quantitatively. Part of this evaluation is performed in the context of a topological mapping algorithm, thus demonstrating the practical applicability of the detector.
Out-of-Core Bundle Adjustment for Large-Scale 3D Reconstruction

(Georgia Institute of Technology, 2007-10) Ni, Kai ; Steedly, Drew ; Dellaert, Frank

Large-scale 3D reconstruction has recently received much attention from the computer vision community. Bundle adjustment is a key component of 3D reconstruction problems. However, traditional bundle adjustment algorithms require a considerable amount of memory and computational resources. In this paper, we present an extremely efficient, inherently out-of-core bundle adjustment algorithm. We decouple the original problem into several submaps that have their own local coordinate systems and can be optimized in parallel. A key contribution to our algorithm is making as much progress towards optimizing the global non-linear cost function as possible using the fragments of the reconstruction that are currently in core memory. This allows us to converge with very few global sweeps (often only two) through the entire reconstruction. We present experimental results on large-scale 3D reconstruction datasets, both synthetic and real.
Fast 3D Pose Estimation With Out-of-Sequence Measurements

(Georgia Institute of Technology, 2007-10) Ranganathan, Ananth ; Kaess, Michael ; Dellaert, Frank

We present an algorithm for pose estimation using fixed-lag smoothing. We show that fixed-lag smoothing enables inclusion of measurements from multiple asynchronous measurement sources in an optimal manner. Since robots usually have a plurality of uncoordinated sensors, our algorithm has an advantage over filtering-based estimation algorithms, which cannot incorporate delayed measurements optimally. We provide an implementation of the general fixed-lag smoothing algorithm using square root smoothing, a technique that has recently become prominent. Square root smoothing uses fast sparse matrix factorization and enables our fixed-lag pose estimation algorithm to run at upwards of 20 Hz. Our algorithm has been extensively tested over hundreds of hours of operation on a robot operating in outdoor environments. We present results based on these tests that verify our claims using wheel encoders, visual odometry, and GPS as sensors.
Semantic Modeling of Places using Objects

(Georgia Institute of Technology, 2007-06) Ranganathan, Ananth ; Dellaert, Frank

While robot mapping has seen massive strides recently, higher level abstractions in map representation are still not widespread. Maps containing semantic concepts such as objects and labels are essential for many tasks in manmade environments as well as for human-robot interaction and map communication. In keeping with this aim, we present a model for places using objects as the basic unit of representation. Our model is a 3D extension of the constellation object model, popular in computer vision, in which the objects are modeled by their appearance and shape. The 3D location of each object is maintained in a coordinate frame local to the place. The individual object models are learned in a supervised manner using roughly segmented and labeled training images. Stereo range data is used to compute 3D locations of the objects. We use the Swendsen-Wang algorithm, a cluster MCMC method, to solve the correspondence problem between image features and objects during inference. We provide a technique for building panoramic place models from multiple views of a location. An algorithm for place recognition by comparing models is also provided. Results are presented in the form of place models inferred in an indoor environment.We envision the use of our place model as a building block towards a complete object-based semantic mapping system.
Inferring Temporal Order of Images From 3D Structure

(Georgia Institute of Technology, 2007-06) Schindler, Grant ; Dellaert, Frank ; Kang, Sing Bing

In this paper, we describe a technique to temporally sort a collection of photos that span many years. By reasoning about persistence of visible structures, we show how this sorting task can be formulated as a constraint satisfaction problem (CSP). Casting this problem as a CSP allows us to efficiently find a suitable ordering of the images despite the large size of the solution space (factorial in the number of images) and the presence of occlusions. We present experimental results for photographs of a city acquired over a one hundred year period.