ERAN TREISTER

Senior Academic

pISTA

PRECONDITIONED ITERATIVE SOFT THRESHOLDING ALGORITHM FOR GRAPHICAL LASSO

Gal Shalom, Eran Treister, Irad Yavneh

We propose a novel quasi-Newton method for solving the sparse inverse covariance estimation problem also known as the graphical least absolute shrinkage and selection operator (GLASSO). This problem is often solved using a second-order quadratic approximation. However, in such algorithms the Hessian term is complex and computationally expensive to handle. Therefore, our method uses the inverse of the Hessian as a preconditioner to simplify and approximate the quadratic element at the cost of a more complex \ell1 element. The variables of the resulting preconditioned problem are coupled only by the \ell1 subderivative of each other, which can be guessed with minimal cost using the gradient itself, allowing the algorithm to be parallelized and implemented efficiently on GPU hardware accelerators. Numerical results on synthetic and real data demonstrate that our method is competitive with other state-of-the-art approaches.

Publication language English
Pages S445-S466
Journal SIAM Journal on Scientific Computing
Volume 46
Issue number 2
Publication status Published - 01.04.2024

Keywords

graphical LASSO
preconditioning
proximal methods
sparse precision matrix estimation

ASJC Scopus subject areas

Computational Mathematics
Applied Mathematics
Access to Document
10.1137/22M1496128
Other files and links
Link to publication in Scopus