Shape-Colour Histograms for matching 3D video sequences

Most 3D object retrieval and matching methods only consider geometric similarity. This paper introduces a novel descriptor, Shape-Colour Histograms, to match objects with similar shape and appearance. This is motivated by the requirement to concatenate captured 3D video sequences for animation production. A quantitative evaluation based on the Receiver-Operator Characteristic (ROC) curve is presented to compare the performance of conventional 3D shape descriptors and new shape-colour descriptors with temporal filtering in the task to match 3D video sequences. 3D shape descriptors including Shape Histogram, LightField are considered. Evaluation shows that filtered Shape-Colour Histograms outperform descriptors using shape only. Finally, temporal Shape-Colour Histograms are applied to a publically available database of 3D video of people to identify optimal transitions and synthesize 3D character animation. Results demonstrate the accurate matching of surface shape, appearance and motion at transition points.