Optimizing a triangular mesh by separately dealing with incorrectness of two patches

In reconstructing 3-D shape from images based on feature points, we usually define a triangular mesh that has those feature points as vertices, and display the object as a polyhedron. If the object itself is a polyhedron, however, some of the displayed edges may be inconsistent with the true shape. For this problem, Nakatsuji et al. proposed a method that automatically eliminates such inconsistencies by flipping triangular edges using a special template. In this paper, we point out a problem of the Nakatsuji's method and propose a new method for overcoming this problem. Using real images, we demonstrate that our method effectively works for complicated mash inconsistencies.