Automatic 3D Multiple Building Change Detection Model Based on Encoder–Decoder Network Using Highly Unbalanced Remote Sensing Datasets

3-D building change detection (CD) methods detect more accurate multiple change maps than 2-D ones. Recent technologies, such as unmanned aerial vehicle (UAV) systems and dense image matching have made it much easier to obtain 3-D data nowadays. Developing a solution which produces an accurate map of multiple building changes, including unclassified, no building change, newly built, demolished, and taller, at an acceptable speed is a challenging issue. In this article, we address a novel 3-D building CD method based on an encoder–decoder network to detect accurate multiple changes maps automatically, in the presence of highly unbalanced remote sensing datasets. The proposed method consists of three main parts: the preprocessing and mixed augmentation (MA) step; the encoder–decoder network training; and finally the prediction step. The data are augmented by the MA method to manipulate highly unbalanced datasets. The encoder–decoder network is constructed by the Yolov7 network as the encoder path and the decoder path equipped with the convolutional layers of modified Unet). Two datasets are used in this article. The first dataset is the point clouds and orthophotos obtained from the UAV of Mashhad City in 2011 and 2016. The second dataset consists of stereo images of the GeoEye-1 satellite and the point clouds obtained from dense image matching of Tehran city in 2009 and 2013. The results show that the proposed method achieved accuracy and kappa coefficients above 94% and 0.90 for both datasets, respectively.