EDHnet: An Event-Based Dual-Stream Hybrid Network for Image Motion Deblurring

The exposure time causes inevitable motion blurring in the traditional frame-based cameras’ imaging. In contrast, event cameras, inspired by biology, are renowned for their high temporal resolution, which can capture motion information in microseconds (even nanoseconds), thus offering a promising new approach to the motion-deblurring task. In this article, we introduce a novel event-based dual-stream hybrid deblurring network (EDHNet) for motion deblurring. It divides the deblurring task into two sub-tasks for severe and mild motion blurs, corresponding to event stream data with different spatio-temporal densities. Our network employs severe-deblurring network (SDNet) and mild-deblurring network (MDNet) to address severe and mild motion blurs, respectively, and integrates a fusion module to generate the final sharp images from the combined output features of these two branches. To tackle the severe blur and dense event stream, spiking neural networks and convolutional neural networks (CNNs) are adopted to make a feature extraction from the event stream and employ a dual cross-attention module to fuse the features from event stream data and images. For the mild blurs, CNNs are adopted, where a residual fusion layer is proposed to effectively leverage sparse event data. The experimental results confirm that our method establishes a new state-of-the-art on GoPro dataset for motion deblurring and demonstrates exceptional generalization capabilities in real-world blur scenarios.