Study on 6D Pose Estimation System of Occlusion Targets for the Spherical Amphibious Robot based on Neural Network

The amphibious robot needs to accurately estimate the 6D pose of the target in tasks such as target tracking, docking with the recovery module, and target grasping. The current research on target 6D pose estimation is mainly applied to unoccluded targets, but when the target is occluded, the target’s pose cannot be accurately identified. Compared with other algorithms, the PVNet algorithm shows better robustness when target is occluded, but the accuracy is still low. To improve the accuracy of the PVNet algorithm, this paper adds the confidence score prediction of the prediction vector at the last layer of the PVNet network, and designs a vector confidence score loss function to train the network. Before generating the hypothetical keypoints, the pixels whose confidence score is lower than the set threshold are screened out, so that the generated hypothetical 2D keypoints are closer to the true 2D keypoints. Finally, the method in this paper is compared with the Tekin, PoseCNN, Oberweger and Pvnet algorithm, and demonstrate the superiority of the proposed method.