Skip to main content
Article
Projected Nesterov’s Proximal-Gradient Algorithm for Sparse Signal Recovery
IEEE Transactions on Signal Processing
  • Renliang Gu, Iowa State University
  • Aleksandar Dogandzic, Iowa State University
Document Type
Article
Publication Version
Accepted Manuscript
Publication Date
7-1-2017
DOI
10.1109/TSP.2017.2691661
Abstract

We develop a projected Nesterov's proximal-gradient (PNPG) approach for sparse signal reconstruction that combines adaptive step size with Nesterov's momentum acceleration. The objective function that we wish to minimize is the sum of a convex differentiable data-fidelity (negative log-likelihood (NLL)) term and a convex regularization term. We apply sparse signal regularization where the signal belongs to a closed convex set within the closure of the domain of the NLL; the convex-set constraint facilitates flexible NLL domains and accurate signal recovery. Signal sparsity is imposed using the ℓ1 -norm penalty on the signal's linear transform coefficients. The PNPG approach employs a projected Nesterov's acceleration step with restart and a duality-based inner iteration to compute the proximal mapping. We propose an adaptive step-size selection scheme to obtain a good local majorizing function of the NLL and reduce the time spent backtracking. Thanks to step-size adaptation, PNPG converges faster than the methods that do not adjust to the local curvature of the NLL. We present an integrated derivation of the momentum acceleration and proofs of O(k−2) objective function convergence rate and convergence of the iterates, which account for adaptive step size, inexactness of the iterative proximal mapping, and the convex-set constraint. The tuning of PNPG is largely application independent. Tomographic and compressed-sensing reconstruction experiments with Poisson generalized linear and Gaussian linear measurement models demonstrate the performance of the proposed approach.

Comments

This is a manuscript of an article published as Gu, Renliang, and Aleksandar Dogandžić. "Projected Nesterov's Proximal-Gradient Algorithm for Sparse Signal Recovery." IEEE Transactions on Signal Processing 65, no. 13 (2017): 3510-525. doi:10.1109/TSP.2017.2691661. Posted with permission.

Rights
Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Copyright Owner
IEEE
Language
en
File Format
application/pdf
Citation Information
Renliang Gu and Aleksandar Dogandzic. "Projected Nesterov’s Proximal-Gradient Algorithm for Sparse Signal Recovery" IEEE Transactions on Signal Processing Vol. 65 Iss. 13 (2017) p. 3510 - 3525
Available at: http://works.bepress.com/aleksandar_dogandzic/39/