Effect of Varied Datasets on Training of a Segmentation Model Used in Visual Navigation

A visual navigation method based on results of semantic segmentation showed interesting results in previous researches. The most significant problem of the method is that the moving performance is affected by the segmentation accuracy, which strongly depends on the training data even though SOTA methods are adopted. To create high-quality dataset for this application without huge human efforts, the authors tries to generate datasets for semantic segmentation from a 3D scanned data composed of colored point clouds. In this study, we investigate what kinds of variations are effective to construct a classifier: variation of augmentation considering shadows, shooting angles, and shooting locations. Experimental results using actual images for evaluation and generated dataset for training captured at the course of Tsukuba Challenge, which is the famous competition for autonomous moving robots in Japan, showed that adding shadows in training datasets improved the mIoU but random changes to the shooting angle and location did not always work well. By the result, it is shown that augmentation considering the characteristic of the target environment becomes important for practical use.