Identification Of Buildings In Street Images Using Map Information

In this paper, we propose a method that identifies the buildings in a street image by accurately associating their locations between a map and an image. Building identification is beneficial to the use of images for detailed navigation. Given that a GPS-based camera pose (location and direction) embedded in EXIF of the image is available, we propose a method to improve the camera pose by using a depth map estimated from the image and the depth information taken from the map. By improving the camera pose of the image, we can identify the building in the image by accurate registration of the building on the map and that in the image. In our experiments, we use Google Street View images with their camera poses and demonstrate significant accuracy improvement in building identification.