Table of Contents
Fetching ...

Hyperspectral Image Spectral-Spatial Feature Extraction via Tensor Principal Component Analysis

Yuemei Ren, Liang Liao, Stephen John Maybank, Yanning Zhang, Xin Liu

TL;DR

The paper addresses hyperspectral image classification by tackling the challenge of spectral-spatial feature extraction. It introduces a tensor-based framework built on the t-product with circular convolution and extends PCA to Tensor PCA (TPCA), including a fast Fourier-domain implementation that achieves $O(mn)$ complexity. Key contributions include a backward-compatible tensor algebra, a TPCA method that captures spatial relations via tensor covariance, and an empirical demonstration on Indian Pines and Pavia University showing TPCA outperforms traditional PCA and state-of-the-art tensor methods. The work demonstrates that leveraging multi-dimensional tensor structure yields superior spectral-spatial representations and scalable improvements for hyperspectral analysis.

Abstract

This paper addresses the challenge of spectral-spatial feature extraction for hyperspectral image classification by introducing a novel tensor-based framework. The proposed approach incorporates circular convolution into a tensor structure to effectively capture and integrate both spectral and spatial information. Building upon this framework, the traditional Principal Component Analysis (PCA) technique is extended to its tensor-based counterpart, referred to as Tensor Principal Component Analysis (TPCA). The proposed TPCA method leverages the inherent multi-dimensional structure of hyperspectral data, thereby enabling more effective feature representation. Experimental results on benchmark hyperspectral datasets demonstrate that classification models using TPCA features consistently outperform those using traditional PCA and other state-of-the-art techniques. These findings highlight the potential of the tensor-based framework in advancing hyperspectral image analysis.

Hyperspectral Image Spectral-Spatial Feature Extraction via Tensor Principal Component Analysis

TL;DR

The paper addresses hyperspectral image classification by tackling the challenge of spectral-spatial feature extraction. It introduces a tensor-based framework built on the t-product with circular convolution and extends PCA to Tensor PCA (TPCA), including a fast Fourier-domain implementation that achieves complexity. Key contributions include a backward-compatible tensor algebra, a TPCA method that captures spatial relations via tensor covariance, and an empirical demonstration on Indian Pines and Pavia University showing TPCA outperforms traditional PCA and state-of-the-art tensor methods. The work demonstrates that leveraging multi-dimensional tensor structure yields superior spectral-spatial representations and scalable improvements for hyperspectral analysis.

Abstract

This paper addresses the challenge of spectral-spatial feature extraction for hyperspectral image classification by introducing a novel tensor-based framework. The proposed approach incorporates circular convolution into a tensor structure to effectively capture and integrate both spectral and spatial information. Building upon this framework, the traditional Principal Component Analysis (PCA) technique is extended to its tensor-based counterpart, referred to as Tensor Principal Component Analysis (TPCA). The proposed TPCA method leverages the inherent multi-dimensional structure of hyperspectral data, thereby enabling more effective feature representation. Experimental results on benchmark hyperspectral datasets demonstrate that classification models using TPCA features consistently outperform those using traditional PCA and other state-of-the-art techniques. These findings highlight the potential of the tensor-based framework in advancing hyperspectral image analysis.

Paper Structure

This paper contains 11 sections, 1 theorem, 23 equations, 4 figures, 1 table, 3 algorithms.

Key Result

Theorem 2.1

Given $x_t, y_t \in \mathbbm{F}^{m\times n}$ and $d_t = x_t \circ y_t$, along with their 2D-DFTs $F(x_t)$, $F(y_t)$, and $F(d_t)$, we have

Figures (4)

  • Figure 1: Classification maps generated using RF with different types of features on the Indian Pines dataset. (a) Indian Pines scene, (b) Ground-truth, (c) Original, (d) PCA, (e) LDA, (f) TDLA, (g) LTDA, (h) TPCA.
  • Figure 2: Classification maps generated using RF with different types of features on the Pavia University dataset. (a) Pavia University scene, (b) Ground-truth, (c) Original, (d) PCA, (e) LDA, (f) TDLA, (g) LTDA, (h) TPCA.
  • Figure 3: Classification accuracy curves for the Indian Pines dataset using PCA and TPCA combined with NN, SVM, and RF classifiers. (a) NN, (b) SVM, and (c) RF.
  • Figure 4: Classification accuracy curves for the Pavia University dataset using PCA and TPCA combined with NN, SVM, and RF classifiers. (a) NN, (b) SVM, and (c) RF.

Theorems & Definitions (13)

  • Definition 2.1: Tensor Addition
  • Definition 2.2: Tensor Multiplication (Circular Convolution)
  • Theorem 2.1: Fourier Transform
  • Definition 2.3: Scalar Multiplication
  • Definition 2.4: $C$-Vectors and $C$-Matrices
  • Definition 2.5: $C$-Matrix Multiplication
  • Definition 2.6: Identity $C$-Matrix
  • Definition 2.7: Conjugate in $C$
  • Definition 2.8: Hermitian Transpose of a $C$-Matrix
  • Definition 2.9: Unitary $C$-Matrix
  • ...and 3 more