Enhanced DIBR Framework for Free Viewpoint Video

DIBR (depth-image-based-rendering) is an essential technology for free-viewpoint video. However, the existing DIBR framework cannot resolve the artifacts, blur, and temporal inconsistency in the synthesized video due to the imperfect depth map. In this paper, we proposed an enhanced DIBR framework to improve the quality of the synthesized virtual view. Firstly, we reconstruct the background of the reference views to refine the reference depth maps and fill holes in the synthesized virtual view to improve the quality and temporal consistency. Then we mark the edge between the foreground and background of the reference view and modify the post-processing method of the virtual view depth map to avoid artifacts. Finally, we propose a foreground edge filtering method to make the synthesized virtual view more realistic. The experiments show that our enhanced DIBR framework can achieve superior performance and improve the temporal consistency in the virtual view.