A multiscale region-based approach to image matching

This paper presents a new technique for the estimation of 2D motion fields from image sequences. Homogeneous regions are identified and matched using a multiscale segmentation algorithm. Many matching difficulties result from structural changes in an image which occur only at certain scales and, hence, a multiscale approach results in a denser set of matched regions. Pixel correspondences are then obtained by estimating an affine transformation between matched regions. A motion field is then calculated from these correspondences. Areas where occlusion is present are identified and the effects of the occlusion on the affine parameter estimation process are compensated, resulting in a more accurate estimated motion field.