Tales of Shape and Radiance in Multi-view Stereo

Author(s)
Soatto, Stefano
Jin, Hailin
Advisor(s)
Editor(s)
Associated Organization(s)
Series
Supplementary to:
Abstract
To what extent can three-dimensional shape and radiance be inferred from a collection of images? Can the two be estimated separately while retaining optimality? How should the optimality criterion be computed? When is it necessary to employ an explicit model of the reflectance properties of a scene? In this paper we introduce a separation principle for shape and radiance estimation that applies to Lambertian scenes and holds for any choice of norm. When the scene is not Lambertian, however, shape cannot be decoupled from radiance, and therefore matching image-to-image is not possible directly. We employ a rank constraint on the radiance tensor, which is commonly used in computer graphics, and construct a novel cost functional whose minimization leads to an estimate of both shape and radiance for non-Lambertian objects, which we validate experimentally.
Sponsor
Date
2003-10
Extent
Resource Type
Text
Resource Subtype
Post-print
Proceedings
Rights Statement
Rights URI