Regularized Building Segmentation by Frame Field Learning

We add a frame field output to an image segmentation neural network to improve segmentation quality and provide structural information for a subsequent polygonization step. A frame field encodes two directions up to sign at every point of an image. To improve segmentation, we train a network to align an output frame field to the tangents of ground truth contours. In addition to increasing performance by leveraging the multi-task learning effect, our method produces more regular segmentations with sharp building corners. GitHub: github.com/Lydorn/Polygonization-by-Frame-Field-Learning.