Stochastic Deep Image Prior for Multishot Compressive Spectral Image Fusion | IEEE Conference Publication | IEEE Xplore

Stochastic Deep Image Prior for Multishot Compressive Spectral Image Fusion


Abstract:

The Deep Image Prior (DIP) technique has been successfully employed in Compressive Spectral Imaging (CSI) as a non-data-driven deep model approach. DIP methodology update...Show More

Abstract:

The Deep Image Prior (DIP) technique has been successfully employed in Compressive Spectral Imaging (CSI) as a non-data-driven deep model approach. DIP methodology updates the deep network’s weights by minimizing a loss function that considers the difference between the measurements and the forward operator of the network’s output. However, this method often yields local minima as all the measurements are evaluated at each iteration. This paper proposes a stochastic deep image prior (SDIP) approach, which stochastically trains DIP networks using random subsets of measurements from different CSI sensors in a CSI fusion (CSIF) setting, resulting in the improvement of the convergence through stochastic gradient descent optimization. The proposed SDIP method improves upon the deterministic DIP and requires less computational time since fewer forward operators are required per iteration. The SPID method provides comparable performance against the state-of-the-art CSF techniques based on supervised data-driven and unsupervised methods, achieving up to 5 dB in the reconstruction.
Date of Conference: 04-10 June 2023
Date Added to IEEE Xplore: 02 August 2023
ISBN Information:
Conference Location: Rhodes Island, Greece

Funding Agency:


Contact IEEE to Subscribe

References

References is not available for this document.