Overview of the proposed video stitching algorithm.
Abstract:
Conventional stitching techniques for images and videos are based on smooth warping models, and therefore, they often fail to work on multi-view images and videos with la...Show MoreMetadata
Abstract:
Conventional stitching techniques for images and videos are based on smooth warping models, and therefore, they often fail to work on multi-view images and videos with large parallax captured by cameras with wide baselines. In this paper, we propose a novel video stitching algorithm for such challenging multi-view videos. We estimate the parameters of ground plane homography, fundamental matrix, and vertical vanishing points reliably, using both of the appearance and activity-based feature matches validated by geometric constraints. We alleviate the parallax artifacts in stitching by adaptively warping the off-plane pixels into geometrically accurate matching positions through their ground plane pixels based on the epipolar geometry. We also exploit the inter-view and inter-frame correspondence matching information together to estimate the ground plane pixels reliably, which are then refined by energy minimization. Experimental results show that the proposed algorithm provides geometrically accurate stitching results of multi-view videos with large parallax and outperforms the state-of-the-art stitching methods qualitatively and quantitatively.
Overview of the proposed video stitching algorithm.
Published in: IEEE Access ( Volume: 6)
Funding Agency:
![Author image of Kyu-Yul Lee](/mediastore/IEEE/content/freeimages/6287639/8274985/8357884/lee-2835659-small.gif)
Ulsan National Institute of Science and Technology, Ulsan, Ulsan, KR
Kyu-Yul Lee received the B.S. degree in electrical and computer engineering from the Ulsan National Institute of Science and Technology, Ulsan, South Korea, in 2013, where he is currently pursuing the Ph.D. degree in electrical and computer engineering. His research interests include correspondence matching, video stitching, and deep learning.
Kyu-Yul Lee received the B.S. degree in electrical and computer engineering from the Ulsan National Institute of Science and Technology, Ulsan, South Korea, in 2013, where he is currently pursuing the Ph.D. degree in electrical and computer engineering. His research interests include correspondence matching, video stitching, and deep learning.View more
![Author image of Jae-Young Sim](/mediastore/IEEE/content/freeimages/6287639/8274985/8357884/sim-2835659-small.gif)
Ulsan National Institute of Science and Technology, Ulsan, Ulsan, KR
Jae-Young Sim (S’02–M’06) received the B.S. degree in electrical engineering and the M.S. and Ph.D. degrees in electrical engineering and computer science from Seoul National University, Seoul, South Korea, in 1999, 2001, and 2005, respectively. From 2005 to 2009, he was a Research Staff Member with the Samsung Advanced Institute of Technology, Samsung Electronics Company Ltd. In 2009, he joined the School of Electrical a...Show More
Jae-Young Sim (S’02–M’06) received the B.S. degree in electrical engineering and the M.S. and Ph.D. degrees in electrical engineering and computer science from Seoul National University, Seoul, South Korea, in 1999, 2001, and 2005, respectively. From 2005 to 2009, he was a Research Staff Member with the Samsung Advanced Institute of Technology, Samsung Electronics Company Ltd. In 2009, he joined the School of Electrical a...View more
![Author image of Kyu-Yul Lee](/mediastore/IEEE/content/freeimages/6287639/8274985/8357884/lee-2835659-small.gif)
Ulsan National Institute of Science and Technology, Ulsan, Ulsan, KR
Kyu-Yul Lee received the B.S. degree in electrical and computer engineering from the Ulsan National Institute of Science and Technology, Ulsan, South Korea, in 2013, where he is currently pursuing the Ph.D. degree in electrical and computer engineering. His research interests include correspondence matching, video stitching, and deep learning.
Kyu-Yul Lee received the B.S. degree in electrical and computer engineering from the Ulsan National Institute of Science and Technology, Ulsan, South Korea, in 2013, where he is currently pursuing the Ph.D. degree in electrical and computer engineering. His research interests include correspondence matching, video stitching, and deep learning.View more
![Author image of Jae-Young Sim](/mediastore/IEEE/content/freeimages/6287639/8274985/8357884/sim-2835659-small.gif)
Ulsan National Institute of Science and Technology, Ulsan, Ulsan, KR
Jae-Young Sim (S’02–M’06) received the B.S. degree in electrical engineering and the M.S. and Ph.D. degrees in electrical engineering and computer science from Seoul National University, Seoul, South Korea, in 1999, 2001, and 2005, respectively. From 2005 to 2009, he was a Research Staff Member with the Samsung Advanced Institute of Technology, Samsung Electronics Company Ltd. In 2009, he joined the School of Electrical and Computer Engineering, Ulsan National Institute of Science and Technology, Ulsan, South Korea, where he is currently an Associate Professor. His research interests include image, video, and 3-D visual processing, computer vision, and multimedia data compression.
Jae-Young Sim (S’02–M’06) received the B.S. degree in electrical engineering and the M.S. and Ph.D. degrees in electrical engineering and computer science from Seoul National University, Seoul, South Korea, in 1999, 2001, and 2005, respectively. From 2005 to 2009, he was a Research Staff Member with the Samsung Advanced Institute of Technology, Samsung Electronics Company Ltd. In 2009, he joined the School of Electrical and Computer Engineering, Ulsan National Institute of Science and Technology, Ulsan, South Korea, where he is currently an Associate Professor. His research interests include image, video, and 3-D visual processing, computer vision, and multimedia data compression.View more