Progressive Multiview Instance Matching: Occlusion-Robust Approach With Initial Segmentation Enhancement

The growing demand for immersive media has led to active research on multiview images. However, challenges such as occlusion and the lack of publicly available multiview datasets hinder progress in this field. To address these issues, we introduce a novel dataset, synthetic multiview images for instance matching (SMIIM), designed for multiview instance matching. We also propose a progressive matching algorithm, a three-stage process that effectively handles occlusion. Finally, we improve the image segmentation results by refining the masks generated by existing networks with our matching results. Compared to the existing instance matching algorithms, our method not only provides faster processing time but also significantly enhances performance, achieving an average ID matching accuracy of 97.5% and a mean intersection over union (mIoU) improvement of 19.8% not only on our dataset but also on standardized datasets and real-world datasets. Multiobject matching in multiview environments is rare, making our research a valuable contribution to this field. The SMIIM dataset will be released to facilitate further research and development in the field of multiview image processing.