A New Active Image Captioning Fusion Strategy

Image captioning aims to describe the content of an image through a textual description including attributes and relationships of detected objects. In remote sensing (RS) community IC is becoming an interesting solution for the study of very high spatial resolution (VHR) images that are characterized by high-level information detail. RSIC systems are developed in a supervised way where annotated samples are needed to train the system. However, obtaining a large amount of annotated samples is time-consuming and costly. To address this issue, in this work we propose an active learning solution to select the most important samples to label and include in the training set with the aim of maintaining the system's accuracy as high as possible while using a few amount of training samples. The most important samples are selected based on decision uncertainty and diversity criteria. Experimental results show that the proposed active learning solution represents a good trade-off between the number of training samples and the accuracy of the system.