Stitching for Multi-View Videos With Large Parallax Based on Adaptive Pixel Warping | IEEE Journals & Magazine | IEEE Xplore

Stitching for Multi-View Videos With Large Parallax Based on Adaptive Pixel Warping

Open Access

Overview of the proposed video stitching algorithm.

Abstract:

Conventional stitching techniques for images and videos are based on smooth warping models, and therefore, they often fail to work on multi-view images and videos with la...Show More

Abstract:

Conventional stitching techniques for images and videos are based on smooth warping models, and therefore, they often fail to work on multi-view images and videos with large parallax captured by cameras with wide baselines. In this paper, we propose a novel video stitching algorithm for such challenging multi-view videos. We estimate the parameters of ground plane homography, fundamental matrix, and vertical vanishing points reliably, using both of the appearance and activity-based feature matches validated by geometric constraints. We alleviate the parallax artifacts in stitching by adaptively warping the off-plane pixels into geometrically accurate matching positions through their ground plane pixels based on the epipolar geometry. We also exploit the inter-view and inter-frame correspondence matching information together to estimate the ground plane pixels reliably, which are then refined by energy minimization. Experimental results show that the proposed algorithm provides geometrically accurate stitching results of multi-view videos with large parallax and outperforms the state-of-the-art stitching methods qualitatively and quantitatively.
Overview of the proposed video stitching algorithm.
Published in: IEEE Access ( Volume: 6)
Page(s): 26904 - 26917
Date of Publication: 11 May 2018
Electronic ISSN: 2169-3536

Funding Agency:


References

References is not available for this document.