Table of Contents
Fetching ...

Randomized Large-Scale Quaternion Matrix Approximation: Practical Rangefinders and One-Pass Algorithm

Chao Chang, Yuning Yang

TL;DR

The paper tackles large-scale low-rank approximation of quaternion matrices by introducing two practical rangefinders, pseudo-QR and pseudo-SVD, that operate via complex representations to accelerate quaternion computations. These rangefinders are integrated into a quaternion one-pass randomized algorithm, with deterministic and probabilistic error bounds showing the truncation error scales with the rangefinder condition κ(H) while preserving the data range. The approach delivers substantial speed-ups over existing quaternion orthonormalization-based methods and demonstrates high-accuracy, scalable compression on synthetic data, a CFD simulation, a 4D Lorenz-type chaotic system, and a large color image. The work provides rigorous QB error analyses for Gaussian and sub-Gaussian embeddings and releases MATLAB code, highlighting practical impact for large-scale quaternion data processing.

Abstract

Recently, randomized algorithms for low-rank approximation of quaternion matrices have received increasing attention. However, for large-scale problems, existing quaternion orthonormalizations are inefficient, leading to slow rangefinders. To address this, by appropriately leveraging efficient scientific computing libraries in the complex arithmetic, this work devises two practical quaternion rangefinders, one of which is non-orthonormal yet well-conditioned. They are then integrated into the quaternion version of a one-pass algorithm, which originally takes orthonormal rangefinders only. We establish the error bounds and demonstrate that the error is proportional to the condition number of the rangefinder. The probabilistic bounds are exhibited for both quaternion Gaussian and sub-Gaussian embeddings. Numerical experiments demonstrate that the one-pass algorithm with the proposed rangefinders significantly outperforms previous techniques in efficiency. Additionally, we tested the algorithm in a 3D Navier-Stokes equation ($5.22$GB) and a 4D Lorenz-type chaotic system ($5.74$GB) data compression, as well as a $31365\times 27125$ image compression to demonstrate its capability for handling large-scale applications.

Randomized Large-Scale Quaternion Matrix Approximation: Practical Rangefinders and One-Pass Algorithm

TL;DR

The paper tackles large-scale low-rank approximation of quaternion matrices by introducing two practical rangefinders, pseudo-QR and pseudo-SVD, that operate via complex representations to accelerate quaternion computations. These rangefinders are integrated into a quaternion one-pass randomized algorithm, with deterministic and probabilistic error bounds showing the truncation error scales with the rangefinder condition κ(H) while preserving the data range. The approach delivers substantial speed-ups over existing quaternion orthonormalization-based methods and demonstrates high-accuracy, scalable compression on synthetic data, a CFD simulation, a 4D Lorenz-type chaotic system, and a large color image. The work provides rigorous QB error analyses for Gaussian and sub-Gaussian embeddings and releases MATLAB code, highlighting practical impact for large-scale quaternion data processing.

Abstract

Recently, randomized algorithms for low-rank approximation of quaternion matrices have received increasing attention. However, for large-scale problems, existing quaternion orthonormalizations are inefficient, leading to slow rangefinders. To address this, by appropriately leveraging efficient scientific computing libraries in the complex arithmetic, this work devises two practical quaternion rangefinders, one of which is non-orthonormal yet well-conditioned. They are then integrated into the quaternion version of a one-pass algorithm, which originally takes orthonormal rangefinders only. We establish the error bounds and demonstrate that the error is proportional to the condition number of the rangefinder. The probabilistic bounds are exhibited for both quaternion Gaussian and sub-Gaussian embeddings. Numerical experiments demonstrate that the one-pass algorithm with the proposed rangefinders significantly outperforms previous techniques in efficiency. Additionally, we tested the algorithm in a 3D Navier-Stokes equation (GB) and a 4D Lorenz-type chaotic system (GB) data compression, as well as a image compression to demonstrate its capability for handling large-scale applications.
Paper Structure (30 sections, 37 theorems, 130 equations, 9 figures, 1 table, 5 algorithms)

This paper contains 30 sections, 37 theorems, 130 equations, 9 figures, 1 table, 5 algorithms.

Key Result

Proposition 2.1

Let $\mathbf{ P},\mathbf{ Q}$ be quaternion matrices of proper size. Then

Figures (9)

  • Figure 1: Running time comparisons of QTFM's qr, QHQR, QMGS, and MATLAB's qr and svd (the latter two are applied to the full complex representation; see Sect. \ref{['sec:comlex_representation']} for its definition). $m$ from $1000$ to $5500$, $n=0.1m$.
  • Figure 2: Running Time when $m=20s$: $x$-axis is $m$ and $y$-axis is the running time with log scale (the first two subfigures).
  • Figure 3: $m=1000$, $n=200$, $\kappa(\mathbf{ Y} )$ from $1e6$ to $1e22$.
  • Figure 4: $\xi=0.01,p=2,q=0.25$. Time cost of RQSVD (QHQR, QMGS, Pseudo-SVD) and algorithm \ref{['alg:FixedRankTwoSketches']} (pseudo-QR, pseudo-SVD) of synthetic data. $x$-axis is the target rank; $y$-axis is the running time in seconds.
  • Figure 5: Relative Errors of RQSVD (QHQR, QMGS, Pseudo-SVD) and algorithm \ref{['alg:FixedRankTwoSketches']} (pseudo-QR, pseudo-SVD) of synthetic data. x-label is target rank, y-label is relative $\| A-\hat{A}\|_F/\| A\|_F$.
  • ...and 4 more figures

Theorems & Definitions (72)

  • Proposition 2.1: zhangQuaternionsMatricesQuaternions1997
  • Lemma 2.1
  • Lemma 2.2
  • proof
  • Lemma 2.3
  • proof
  • Lemma 2.4
  • Theorem 2.1
  • Proposition 2.2
  • Lemma 2.5
  • ...and 62 more