Characterizing Tree Species of a Tropical Wetland in Southern China at the Individual Tree Level Based on Convolutional Neural Network

Classification of species at the individual tree level would be beneficial to many applications including forest landscape visualization, forest management, and biodiversity monitoring. This article develops a patch-based classification algorithm of individual tree species based on convolutional neural network. The individual trees are first detected using the local maximum method from the canopy height model, as derived from light detection and ranging (LiDAR) data. The detected individual trees are then cropped into patches for classification based on the tree apexes, and three spatial scale image patches are chosen for analysis and discussion. A modified ResNet50 deep network is further employed for the cropped individual tree patches classification. The patch-based method accounts for the contexture information of a tree and does not require the feature selection or the feature reduction processes. About 1388 training samples including Ficus microcarpa Linn. f., Delonix regia, Chorisia speciosa A.St.-Hil., Dimocarpus longan Lour., Musa nana Lour., Carica papaya, and Others (the other tree species except the above six) were collected from both field work and visual interpretation. Aerial images, LiDAR data, and Worldview images were used for the tree species classification. For 362 test tree samples, the results of patch size 64 achieve the best accuracies, and the proposed method outperforms the traditional machine learning method with the overall accuracy of 89.06% + 0.58% using aerial images only. Transferability Study to the Luhu Park also indicated the feasibility of our method. While challenges in individual tree detection and multisource data fusion remain, the solution shows the potential in characterizing tree species at the individual tree level using remote sensing data.