Restricted Isometry Constants Where $\ell ^{p}$ Sparse Recovery Can Fail for $0≪ p \leq 1$

This paper investigates conditions under which the solution of an underdetermined linear system with minimal lscr
^p
norm, 0 < p les 1, is guaranteed to be also the sparsest one. Matrices are constructed with restricted isometry constants (RIC) delta
_2m
arbitrarily close to 1/radic2 ap 0.707 where sparse recovery with p = 1 fails for at least one m-sparse vector, as well as matrices with delta
_2m
arbitrarily close to one where lscr
¹
minimization succeeds for any m-sparse vector. This highlights the pessimism of sparse recovery prediction based on the RIC, and indicates that there is limited room for improving over the best known positive results of Foucart and Lai, which guarantee that lscr
¹
minimization recovers all m-sparse vectors for any matrix with delta
_2m
< 2(3 - radic2)/7 ap 0.4531. These constructions are a by-product of tight conditions for lscr
^p
recovery (0 les p les 1) with matrices of unit spectral norm, which are expressed in terms of the minimal singular values of 2m-column submatrices. Compared to lscr
¹
minimization, lscr
^p
minimization recovery failure is shown to be only slightly delayed in terms of the RIC values. Furthermore in this case the minimization is nonconvex and it is important to consider the specific minimization algorithm being used. It is shown that when lscr
^p
optimization is attempted using an iterative reweighted lscr
¹
scheme, failure can still occur for delta
_2m
arbitrarily close to 1/radic2.