Nonnegative matrix factorization using ADMM: Algorithm and convergence analysis

The nonnegative matrix factorization (NMF) has been a popular model for a wide range of signal processing and machine learning problems. It is usually formulated as a nonconvex cost minimization problem. This work settles the convergence issue of a popular algorithm based on the alternating direction method of multipliers proposed in Boyd et al 2011. We show that the algorithm converges globally to the set of KKT solutions whenever certain penalty parameter ρ satisfies ρ > 1. We further extend the algorithm and its analysis to the problem where the observation matrix contains missing values. Numerical experiments on real and synthetic data sets demonstrate the effectiveness of the algorithms under investigation.