Accurate Video Alignment Using Phase Correlation

In this letter, we present an accurate technique for temporally aligning two video sequences of the same scene captured by nonsynchronized cameras. An iterative procedure is proposed to successively align the sequences in space and time; and the existing two-dimensional phase-correlation method is generalized into three dimensions to achieve subframe accuracy. The ground-truth of subframe temporal alignment is obtained by using supplementary audio signals sampled at a much higher rate. The accuracy of our technique is demonstrated by experimental results using real-world sequences