Dynamic shape and appearance modeling via moving and deforming layers

Thumbnail Image
Files
jacksonYS06 Dynamic shape and appearance.pdf (1.53 MB)
Author(s)
Jackson, Jeremy D.
Soatto, Stefano
Advisor(s)
Editor(s)
Associated Organization(s)
Organizational Unit
Organizational Unit
Series
Collections
Research Publications
Supplementary to:
Permanent Link
http://hdl.handle.net/1853/48782
Abstract
This model is based on a collection of overlapping layers that can move and deform, each supporting an intensity function that can change over time. We discuss the generality and limitations of this model in relation to existing ones such as traditional optical flow or motion segmentation, layers, deformable templates and deformotion. We then illustrate how this model can be used for inference of shape, motion, deformation and appearance of the scene from a collection of images. The layering structure allows for automatic inpainting of partially occluded regions. We illustrate the model on synthetic and real sequences where existing schemes fail, and show how suitable choices of constants in the model yield existing schemes, from optical flow to motion segmentation, etc.
Sponsor
Date
2008-08
Extent
Resource Type
Text
Resource Subtype
Article
Post-print
Rights Statement
Rights URI