A framework for the registration of color images with 3D models

This paper describes an environment to automatically or semi-automatically compute the precise mapping between a set of 2D images and a triangulated 3D model built from high-resolution 3D range data. This environment is part of our Atelier3D framework for the modeling, visualization and analysis of large sensor-based datasets. This work was done to initially support three cultural heritage application projects: the modeling of the Grotta dei Cervi in Italy, of the Erechtheion in Athens, Greece, and of Leonardo's Mona Lisa. The proposed method combines image-based registration, feature matching, robust estimation techniques and advanced multi-resolution rendering with a powerful user interface.