Bidirectional Hybrid LSTM Based Recurrent Neural Network for Multi-View Stereo | IEEE Journals & Magazine | IEEE Xplore

Bidirectional Hybrid LSTM Based Recurrent Neural Network for Multi-View Stereo


Abstract:

Recently, deep learning based multi-view stereo (MVS) networks have demonstrated their excellent performance on various benchmarks. In this paper, we present an effective...Show More

Abstract:

Recently, deep learning based multi-view stereo (MVS) networks have demonstrated their excellent performance on various benchmarks. In this paper, we present an effective and efficient recurrent neural network (RNN) for accurate and complete dense point cloud reconstruction. Instead of regularizing the cost volume via conventional 3D CNN or unidirectional RNN like previous attempts, we adopt a bidirectional hybrid Long Short-Term Memory (LSTM) based structure for cost volume regularization. The proposed bidirectional recurrent regularization is able to perceive full-space context information comparable to 3D CNNs while saving runtime memory. For post-processing, we introduce a visibility based approach for depth map refinement to obtain more accurate dense point clouds. Extensive experiments on DTU, Tanks and Temples and ETH3D datasets demonstrate that our method outperforms previous state-of-the-art MVS methods and exhibits high memory efficiency at runtime.
Page(s): 3062 - 3073
Date of Publication: 08 April 2022

ISSN Information:

PubMed ID: 35394911

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.