RGBD-Sphere SLAM

This article proposes a SLAM algorithm referred to as RGBD-Sphere SLAM. The key innovation of this work is the prototypical system that demonstrates how formal models of 3D geometric shape and appearance can be transformed into generative classification models that detect and recognize these shapes. Object models are specified as shape programs in PSML; a custom-built procedural language for 3D object modeling. Classifiers for each PSML shape are created by simulating how instances of each shape manifest in real-world sensor data, e.g., color images and range images. The proposed RGBD-Sphere SLAM algorithm demonstrates a prototypical example of the system. Here, the PSML program specifies spherical 3D objects having diffuse surface albedos and distinct color appearances. A recognizer uses PSML models of each object's geometry and appearance to detect instances of these objects within streaming RGBD sensor data. The detected model parameters are then integrated into an RGBD SLAM algorithm; hence the name RGBD-Sphere SLAM. This article describes the PSML programs, the spherical detection and recognition algorithms used, and describes the impact this approach has for improving the performance of RGBD SLAM approaches by incorporating detected objects as landmarks. This is the first example of a prototypical system that externalizes the geometric and appearance modeling to a programming language from which a recognizer is created, and marks an important step towards enabling users to “program” their problem space and allow computers to transform the formal object models, as expressed in PSML, into customized classifiers suited for specific sensor suites, e.g., color imagery and depth imagery.