Hyperspectral Image Super-Resolution via Deep Prior Regularization with Parameter Estimation

Xiuheng Wang (1, 2) , Jie Chen (1) , Qi Wei , Cédric Richard (2)

1 NPU - Northwestern Polytechnical University [Xi'an]
2 LAGRANGE - Joseph Louis LAGRANGE

Hyperspectral image (HSI) super-resolution is commonly used to overcome the hardware limitations of existing hyperspectral imaging systems on spatial resolution. It fuses a low-resolution (LR) HSI and a high-resolution (HR) conventional image of the same scene to obtain an HR HSI. In this work, we propose a method that integrates a physical model and deep prior information. Specifically, a novel, yet effective two-stream fusion network is designed to serve as a regularizer for the fusion problem. This fusion problem is formulated as an optimization problem whose solution can be obtained by solving a Sylvester equation. Furthermore, the regularization parameter is simultaneously estimated to automatically adjust contribution of the physical model and the learned prior to reconstruct the final HR HSI. Experimental results on both simulated and real data demonstrate the superiority of the proposed method over other state-of-the-art methods on both quantitative and qualitative comparisons.

Mots clés: HSI super-resolution; deep learning; fusion; Sylvester equation; regularization parameter estimation

Domaines: Traitement des images [eess.IV]; Intelligence artificielle [cs.AI]

Xiuheng Wang, Jie Chen, Qi Wei, Cédric Richard. Hyperspectral Image Super-Resolution via Deep Prior Regularization with Parameter Estimation. IEEE Transactions on Circuits and Systems for Video Technology, 2021, pp.1-18. ⟨10.1109/TCSVT.2021.3078559⟩. ⟨hal-03352836v1⟩