Skip to main content
Variance-Component Based Sparse Signal Reconstruction and Model Selection
IEEE Transactions on Signal Processing
  • Kun Qiu, Iowa State University
  • Aleksandar Dogandžić, Iowa State University
Document Type
Publication Date

We propose a variance-component probabilistic model for sparse signal reconstruction and model selection. The measurements follow an underdetermined linear model, where the unknown regression vector (signal) is sparse or approximately sparse and noise covariance matrix is known up to a constant. The signal is composed of two disjoint parts: a part with significant signal elements and the complementary part with insignificant signal elements that have zero or small values. We assign distinct variance components to the candidates for the significant signal elements and a single variance component to the rest of the signal; consequently, the dimension of our model's parameter space is proportional to the assumed sparsity level of the signal. We derive a generalized maximum-likelihood (GML) rule for selecting the most efficient parameter assignment and signal representation that strikes a balance between the accuracy of data fit and compactness of the parameterization. We prove that, under mild conditions, the GML-optimal index set of the distinct variance components coincides with the support set of the sparsest solution to the underlying underdetermined linear system. Finally, we propose an expansion-compression variance-component based method (ExCoV) that aims at maximizing the GML objective function and provides an approximate GML estimate of the significant signal element set and an empirical Bayesian signal estimate. The ExCoV method is automatic and demands no prior knowledge about signal-sparsity or measurement-noise levels. We also develop a computationally and memory efficient approximate ExCoV scheme suitable for large-scale problems, apply the proposed methods to reconstruct one- and two-dimensional signals from compressive samples, and demonstrate their reconstruction performance via numerical simulations. Compared with the competing approaches, our schemes perform particularly well in challenging scenarios where the noise is large or the number of measurements is small.


This is a post-print of an article from IEEE Transactions on Signal Processing 58 (2010): 2935–2952, doi:10.1109/TSP.2010.2044828. Posted with permission.

© 2010 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Copyright Owner
Date Available
File Format
Citation Information
Kun Qiu and Aleksandar Dogandžić. "Variance-Component Based Sparse Signal Reconstruction and Model Selection" IEEE Transactions on Signal Processing Vol. 58 Iss. 6 (2010) p. 2935 - 2952
Available at: