Table of Contents
Fetching ...

Asymptotic properties of adaptive group Lasso for sparse reduced rank regression

Kejun He, Jianhua Z. Huang

Abstract

This paper studies the asymptotic properties of the penalized least squares estimator using an adaptive group Lasso penalty for the reduced rank regression. The group Lasso penalty is defined in the way that the regression coefficients corresponding to each predictor are treated as one group. It is shown that under certain regularity conditions, the estimator can achieve the minimax optimal rate of convergence. Moreover, the variable selection consistency can also be achieved, that is, the relevant predictors can be identified with probability approaching one. In the asymptotic theory, the number of response variables, the number of predictors, and the rank number are allowed to grow to infinity with the sample size.

Asymptotic properties of adaptive group Lasso for sparse reduced rank regression

Abstract

This paper studies the asymptotic properties of the penalized least squares estimator using an adaptive group Lasso penalty for the reduced rank regression. The group Lasso penalty is defined in the way that the regression coefficients corresponding to each predictor are treated as one group. It is shown that under certain regularity conditions, the estimator can achieve the minimax optimal rate of convergence. Moreover, the variable selection consistency can also be achieved, that is, the relevant predictors can be identified with probability approaching one. In the asymptotic theory, the number of response variables, the number of predictors, and the rank number are allowed to grow to infinity with the sample size.

Paper Structure

This paper contains 4 sections, 5 theorems, 37 equations.

Key Result

Theorem 1

Assume Conditions con:restricted eigenvalue -- con:variate lasso lambda are satisfied. Then the solution $\widehat{\mathrm{\mathbf{C}}}$ of eqn:chen optimization has the following properties:

Theorems & Definitions (12)

  • Theorem 1: Oracle Properties of the Estimator
  • Remark 1
  • Remark 2
  • Lemma 1
  • Theorem 2
  • Lemma 2
  • proof : Proof of Lemma \ref{['lem:oracle estimator']}
  • Lemma 3
  • proof : Proof of Lemma \ref{['lem:error order2']}
  • proof : Proof of Theorem \ref{['thm:convergence rate']}
  • ...and 2 more