MSSEAG-UNet: A Novel Deep Learning Architecture for Cloud Segmentation in Fisheye Sky Images and Solar Energy Forecast

This study analyzes sky images captured using a ground-based fisheye camera, aiming to address the challenge of accurately segmenting clouds, which is difficult due to their fuzzy and indistinct boundaries and uneven lighting conditions. Accurate segmentation of clouds in ground-based sky images is crucial for accurate solar energy forecasting. Motivated by these challenges, this article has proposed a novel deep learning architecture called multispatial squeeze-and-excite attention gated U-Net (MSSEAG-UNet) for cloud segmentation in ground-based fisheye sky images. The proposed architecture integrates a multispatial convolutional (MS-CNN) block and squeeze-and-excitation (SE) blocks in the encoder path to improve multiscale feature extraction (MFF) and recalibrate feature maps, while an attention block is incorporated in the decoder path to emphasize key cloud features. The segmentation performance of the MSSEAG-UNet is compared with five benchmark models, and results show that the proposed model outperforms than all benchmarks models. Furthermore, the segmented cloud images produced by the MSSEAG-UNet are used to calculate the cloud percentage, which is then integrated with the original sky images using a multicolumn convolutional model for global horizontal irradiance (GHI) forecast. GHI forecast is conducted for 15-, 30-, and 60-min ahead timesteps, with the best results achieved for the 60-min forecast, yielding mean absolute error (MAE), mean square error (mse), and RMSE values of 6.245%, 0.683%, and 8.265%, respectively. These results highlight the effectiveness of the proposed approach in improving both cloud segmentation accuracy and short-term solar irradiance forecasting.