[论文解读] Multiple Measurement Vectors Problem: A Decoupling Property and its Applications

Saeid Haghighatshoar, Giuseppe Caire|arXiv (Cornell University)|Oct 31, 2018

Sparse and Compressive Sensing Techniques参考文献 22被引用 4

一句话总结

本文在多重测量向量（MMV）问题中建立了ℓ₂,₁-正则化最小二乘法（ℓ₂,₁-LS）的解耦性质，证明该算法可分解为协方差估计阶段与基于最小均方误差（MMSE）的独立信号重构阶段。此分解使得能够精确分析信号相关性与字典失配对性能的影响，并由此设计出优于ℓ₂,₁-LS的MMV算法。

ABSTRACT

We study a Compressed Sensing (CS) problem known as Multiple Measurement Vectors (MMV) problem, which arises in joint estimation of multiple signal realizations when the signal samples have a common (joint) sparse support over a fixed known dictionary. Although there is a vast literature on the analysis of MMV, it is not yet fully known how the number of signal samples and their statistical correlations affects the performance of the joint estimation in MMV. Moreover, in many instances of MMV the underlying sparsifying dictionary may not be precisely known, and it is still an open problem to quantify how the dictionary mismatch may affect the estimation performance. In this paper, we focus on $\ell_{2,1}$-norm regularized least squares ($\ell_{2,1}$-LS) as a well-known and widely-used MMV algorithm in the literature. We prove an interesting decoupling property for $\ell_{2,1}$-LS, where we show that it can be decomposed into two phases: i) use all the signal samples to estimate the signal covariance matrix (coupled phase), ii) plug in the resulting covariance estimate as the true covariance matrix into the Minimum Mean Squared Error (MMSE) estimator to reconstruct each signal sample individually (decoupled phase). As a consequence of this decomposition, we are able to provide further insights on the performance of $\ell_{2,1}$-LS for MMV. In particular, we address how the signal correlations and dictionary mismatch affects its performance. Moreover, we show that by using the decoupling property one can obtain a variety of MMV algorithms with performances even better than that of $\ell_{2,1}$-LS. We also provide numerical simulations to validate our theoretical results.

研究动机与目标

• 理解信号样本数量及其统计相关性如何影响多重测量向量（MMV）问题中联合估计性能。
• 量化当稀疏化字典未被完全知晓时，字典失配对ℓ₂,₁-LS在MMV中性能的影响。
• 通过一种新颖的解耦分解，为分析ℓ₂,₁-LS性能建立理论基础。
• 利用解耦性质设计出重建精度优于ℓ₂,₁-LS的改进MMV算法。

提出的方法

• 证明ℓ₂,₁-LS可分解为两个阶段：(i) 利用所有信号样本联合估计信号协方差矩阵；(ii) 使用估计的协方差通过最小均方误差（MMSE）进行独立信号重构。
• 利用矩阵求逆与行列式恒等式（如秩-1更新）推导目标函数关于对偶变量向量γ的导数的闭式表达式。
• 采用坐标逐维最速下降算法优化对偶变量向量γ，使用二分法求解每次坐标更新的最优步长。
• 推导代价函数gₖ(d)关于对偶变量增量d的导数，并将g′ₖ(d) = 0的最大根识别为最优更新方向。
• 通过设置d* = max{d₀, -γₖ}来强制对偶变量的非负性，其中d₀为导数方程的最大解。
• 利用解耦结构分析在不同信号相关性与字典失配下的性能，并设计出增强的MMV算法。

实验结果

研究问题

• RQ1 信号样本数量及其统计相关性如何影响MMV问题中ℓ₂,₁-LS的性能？
• RQ2 当真实稀疏化字典未被完全知晓时，字典失配对ℓ₂,₁-LS估计精度有何影响？
• RQ3 ℓ₂,₁-LS算法能否被分解为两阶段过程，实现联合协方差估计与独立信号重构的分离？
• RQ4 解耦性质是否能用于设计性能优于ℓ₂,₁-LS的MMV算法？
• RQ5 如何通过坐标逐维下降法结合基于二分法的步长选择，高效求解ℓ₂,₁-LS的对偶优化问题？

主要发现

• MMV的ℓ₂,₁-LS估计器具有解耦性质：可分解为联合估计信号协方差矩阵的耦合阶段与使用估计协方差进行MMSE重构的解耦阶段。
• 解耦性质使得能够对信号相关性与字典失配如何降低或提升估计性能进行精确的理论分析。
• 在坐标逐维下降算法中，最优对偶变量更新通过使用二分法求解g′ₖ(d) = 0得到，选择最大根作为最小化器。
• 通过设置d* = max{d₀, -γₖ}确保对偶变量的非负性，其中d₀为导数方程的最大解。
• 所推导的优化框架使得能够设计出在均方误差方面优于ℓ₂,₁-LS的新MMV算法。
• 数值仿真验证了理论发现，确认了解耦近似的准确性与所提算法框架的有效性。