Table of Contents
Fetching ...

On Linear Estimators for some Stable Vectors

Rayan Chouity, Charbel Hannoun, Jihad Fahs, Ibrahim Abou-Faycal

TL;DR

The paper addresses estimating a symmetric $S\alpha S$ variable $X$ from an observation $Y$ under two dependency models: a linear-mix of independent $S\alpha S$ components and an elliptically contoured sub-Gaussian $S\alpha S$ vector. It proves that the conditional mean $\mathsf{E}[X|Y=y]$ is linear in $Y$ in both models and derives dispersion-optimal linear estimators, showing that these estimators differ from the Gaussian case in the linear-mix model but coincide with the Gaussian result in the sub-Gaussian model. In the sub-Gaussian setting, the conditional mean, dispersion-optimal linear estimator, and MAP estimator all align with a single coefficient $\beta=\rho\frac{\sigma_{G_1}}{\sigma_{G_2}}$, highlighting an elegant heavy-tailed extension of Gaussian linear estimation. Overall, the work clarifies when linear estimators remain Bayes-optimal under heavy-tailed dependence and identifies elliptical sub-Gaussian $S\alpha S$ as the natural heavy-tailed analogue to Gaussian linear estimation.

Abstract

We consider the estimation problem for jointly stable random variables. Under two specific dependency models: a linear transformation of two independent stable variables and a sub-Gaussian symmetric $α$-stable (S$α$S) vector, we show that the conditional mean estimator is linear in both cases. Moreover, we find dispersion optimal linear estimators. Interestingly, for the sub-Gaussian (S$α$S) vector, both estimators are identical generalizing the well-known Gaussian result of the conditional mean being the best linear minimum-mean square estimator.

On Linear Estimators for some Stable Vectors

TL;DR

The paper addresses estimating a symmetric variable from an observation under two dependency models: a linear-mix of independent components and an elliptically contoured sub-Gaussian vector. It proves that the conditional mean is linear in in both models and derives dispersion-optimal linear estimators, showing that these estimators differ from the Gaussian case in the linear-mix model but coincide with the Gaussian result in the sub-Gaussian model. In the sub-Gaussian setting, the conditional mean, dispersion-optimal linear estimator, and MAP estimator all align with a single coefficient , highlighting an elegant heavy-tailed extension of Gaussian linear estimation. Overall, the work clarifies when linear estimators remain Bayes-optimal under heavy-tailed dependence and identifies elliptical sub-Gaussian as the natural heavy-tailed analogue to Gaussian linear estimation.

Abstract

We consider the estimation problem for jointly stable random variables. Under two specific dependency models: a linear transformation of two independent stable variables and a sub-Gaussian symmetric -stable (SS) vector, we show that the conditional mean estimator is linear in both cases. Moreover, we find dispersion optimal linear estimators. Interestingly, for the sub-Gaussian (SS) vector, both estimators are identical generalizing the well-known Gaussian result of the conditional mean being the best linear minimum-mean square estimator.
Paper Structure (10 sections, 7 theorems, 68 equations)

This paper contains 10 sections, 7 theorems, 68 equations.

Key Result

Theorem 1

Under the linear-mix model given in equation eq:linmixgen and subject to conditions eq:Cond, for a given observation $Y=y$, the conditional expectation $\mathsf{E}\left[{X \mid Y = y}\right]$ of the S$\alpha$S variable $X$ exists, is linear in $y$ and is given by In particular, whenever $a_{11} = 1, a_{12} = 0$, $Y = a_{21}X + a_{22}{Z_2}$ and

Theorems & Definitions (7)

  • Theorem 1: Linear Mixture Conditional Expectation
  • Theorem 2: Dispersion-Optimal Linear Estimator
  • Lemma 1: The Conditional Representation
  • Lemma 2: Integrability of the residual term
  • Corollary 1: Conditional Mean is Linear in $Y$
  • Theorem 3: Optimal Linear Coefficient under a Dispersion Constraint (sub-Gaussian version)
  • Theorem 4: MAP optimality