Real-time Scene Stabilization and Mosaic Construction
M. Hansen
P. Anandan
K. Dana
G. van der Wal
P. Burt
David Sarnoff Research Center
CN5300
Princeton, NJ-08543
Here is a postscript version of this paper. [1459 Kb]
ABSTRACT
We describe techniques for constructing a stable view of a scene by
aligning images of an incoming video stream and dynamically constructing
an image mosaic. A real-time implementation of one scene stabilization system
using the Vision Front End (VFE-100) processing unit is described. This
system uses frame-to-frame registration to construct the image mosaic
as a stable display. Also, an extension of the stabilization
system is described which can enhance the capabilities of the real-time system.
Significant improvements with this enhanced system include the use of
{\em mosaic-based registration} techniques, which
align imagery to an evolving mosaic rather than to preceding video frames,
and a {\em tiled} mosaic representation,
which uses coordinate transformations to link smaller mosaics together in
order to increase the spatial extent of the mosaic.
Experimental results are shown illustrating the real-time system,
the mosaic-based registration techniques, and the tiled mosaic representation.