Virtual focusing image synthesis for user-specified image region using camera array

Synthetic Aperture Focusing can produce a virtual image where objects lying on a specified focal plane are focused while object lying off the plane are blurred. by averaging the multiview images warped by planar homographies. In this paper, we propose a method for efficiently estimating a focal plane from multiview stereo images so that a user-specified image region is focused in the virtual image. We estimate the 3D parameters of a focal plane, which corresponds to a planar surface in the image region. by using a fast multiview direct method with image pair selection. We select the ‘best‘ image pair by evaluating both pre-computed condition numbers of Hessian matrices and stereo baseline lengths. Our method can rapidly produce a unique virtual image, referred to as a Virtual Focal Plane (VFP) image, where the image region lying on a non-frontparallel plane in the scene is focused.