Registration and fusion of intensity and range data for 3D modelling of real world scenes

A novel technique combining intensity and range data is presented. Passive (intensity based) and active (range based) techniques used for 3D reconstruction have their limitations and separately, none of these techniques can solve all the problems inherent to the modelling of real environments. Our technique aims to demonstrate how both intensity and range data can be registered and combined into a long-range 3D system. The procedure needs an initial estimation for internal and external camera parameters for two or more intensity images. The technique uses passive triangulation of the intensity data to refine the initial camera calibrations and ensure a good registration of range and video data sets. Once a reliable calibration is achieved, corresponding points from the intensity images are triangulated and introduced in the original range data. With our technique, it is possible to complete the models in areas where data is missing or to increase the resolution in areas of high interest and 3D contents.