Learning to Cluster Person in the Video via Graph Convolution Network

Video person re-identification is receiving academic interest. However, the practical application of the algorithm is hardly supported because of prohibitive annotated data. Hence, the study for unlabeled data will lead to an attractive alternative. This work explores an innovative strategy, namely, learning to cluster unlabeled person in the video through graph convolutional networks. In this paper, we find that the possibility of inter-frame linkage can be inferred from context. Therefore, a pose-guided topology linkage clustering framework is proposed. Our framework consists of three modules: (i) a pose-guided representation module; (ii) a pose-guided embedding module; (iii) a link prediction module. Firstly, the representation coding alone is performed at the level of relational induction bias, embedding the implicit pose structure information in image features. Then, based on the consideration of the topology relationship between adjacent and cross-frame, graph convolutional network is introduced to infer the likelihood of linkage between frame nodes. Experiments show that the method demonstrates excellent scalability in addition to being an effective response to person clustering in case of changes, and does not need the number of clusters as a prior.