Loading [a11y]/accessibility-menu.js
Real-Time Dense Depth Estimation Using Semantically-Guided LIDAR Data Propagation and Motion Stereo | IEEE Journals & Magazine | IEEE Xplore

Real-Time Dense Depth Estimation Using Semantically-Guided LIDAR Data Propagation and Motion Stereo


Abstract:

In this letter, we present a method for estimating a dense depth map from a sparse LIDAR point cloud and an image sequence. Our proposed method relies on a directionally ...Show More

Abstract:

In this letter, we present a method for estimating a dense depth map from a sparse LIDAR point cloud and an image sequence. Our proposed method relies on a directionally biased propagation of known depth to missing areas based on semantic segmentation. Additionally, we classify different object boundaries as either occluded or connected to limit the extent of the data propagation. At the regions with large missing point cloud data, we depend on estimated depth using motion stereo. We embed our method on a bounded interpolation strategy which also considers pixel distance, depth difference and color gradient. We then perform an optimization step based on tensor-based TGV-L2 denoising. Our results show that directional propagation and semantic boundary classification can improve the accuracy of interpolation along the edges for different types of objects. Moreover, our motion stereo scheme increases the reliability of extrapolated depth at the regions with large missing point cloud data. Finally, we show that our implementation strategy can achieve reliable results in real time.
Published in: IEEE Robotics and Automation Letters ( Volume: 4, Issue: 4, October 2019)
Page(s): 3806 - 3811
Date of Publication: 05 July 2019

ISSN Information:

Funding Agency:


References

References is not available for this document.