Appearance modeling for mixed reality: photometric aspects

Presents an overview of our efforts on mixed reality. These efforts span two aspects: how to create models of virtual objects and how to integrate such virtual objects with real scenes. For model creation, we have developed two methods (the model-based and eigen-texture rendering methods), both of which automatically create models by observing real objects. For the integration of a virtual object with a real scene, we have developed a method that renders virtual objects based on the real illumination distribution. We have successfully tested the proposed methods by using real images to demonstrate their effectiveness.