Super resolving texture mapping from multiple view images for 3D model construction

There are wide varieties of applications of 3D modeling from real images, which can generate virtual view images by rendering the input images on to a 3D shape model. Because the virtual viewpoint is not generally at the same point, the synthesized image in a virtual view does not have sufficient resolution. To improve this resolution problem, we propose a method for improving the rendered texture resolution. For each vertex of the 3D shape model, the position of the vertex is adjusted to improve the texture of the neighboring triangle patches. For the improvement, the position of the vertex is adjusted by comparing the observation (input image) with the projected image of the model texture. By repeating the visit to every vertex, not only can a super-resolved texture be obtained but also a more accurate 3D patch model. By performing experiments using synthesized multiple-view images of 51 calibrated cameras around the object scene and a real VTR image sequence, it is demonstrated that the proposed method can successfully provide a super-resolved texture image with an improved 3D shape model.