Vanishing points and 3D lines from omnidirectional video

The paper describes a system for structure-from-motion using vanishing points and three-dimensional lines extracted from omnidirectional video sequences. Two novel aspects of this work are its deferred initialization of features using noisy observations from multiple, uncertain vantage points, and its use of dynamic programming for efficient 3D line tracking. We show preliminary results from the system for both indoor and outdoor sequences.