Table of Contents
Fetching ...

Scalable Changepoint Detection for Large Spatiotemporal Data on the Sphere

Samantha Shi-Jun, Bo Li

TL;DR

The paper tackles spatially varying changepoint detection on the Earth by introducing a Bayesian framework that places a spatial multinomial probit prior on location-dependent changepoints ${\tau({\bf s})}$ via a latent Gaussian field $Z({\bf s})$. It achieves scalability through a spherical-harmonic/SPDE representation of latent fields and a Gibbs sampler enabled by the conjugate MPM construction, with a further truncation in the spectral domain to reduce computation. Simulation studies show robust, improved estimation of changepoints under spatial dependence and varying signal regimes, while a global aerosol optical depth application near the Mt Pinatubo eruption demonstrates high-resolution, geographically coherent changepoint patterns consistent with known atmospheric dynamics. Overall, the approach delivers substantial computational gains and accurate inference for large-scale spatiotemporal data on the sphere, enabling practical analysis at native grid resolutions.

Abstract

We propose a novel Bayesian framework for changepoint detection in large-scale spherical spatiotemporal data, with broad applicability in environmental and climate sciences. Our approach models changepoints as spatially dependent categorical variables using a multinomial probit model (MPM) with a latent Gaussian process, effectively capturing complex spatial correlation structures on the sphere. To handle the high dimensionality inherent in global datasets, we leverage stochastic partial differential equations (SPDE) and spherical harmonic transformations for efficient representation and scalable inference, drastically reducing computational burden while maintaining high accuracy. Through extensive simulation studies, we demonstrate the efficiency and robustness of the proposed method for changepoint estimation, as well as the significant computational gains achieved through the combined use of the MPM and truncated spectral representations of latent processes. Finally, we apply our method to global aerosol optical depth data, successfully identifying changepoints associated with a major atmospheric event.

Scalable Changepoint Detection for Large Spatiotemporal Data on the Sphere

TL;DR

The paper tackles spatially varying changepoint detection on the Earth by introducing a Bayesian framework that places a spatial multinomial probit prior on location-dependent changepoints via a latent Gaussian field . It achieves scalability through a spherical-harmonic/SPDE representation of latent fields and a Gibbs sampler enabled by the conjugate MPM construction, with a further truncation in the spectral domain to reduce computation. Simulation studies show robust, improved estimation of changepoints under spatial dependence and varying signal regimes, while a global aerosol optical depth application near the Mt Pinatubo eruption demonstrates high-resolution, geographically coherent changepoint patterns consistent with known atmospheric dynamics. Overall, the approach delivers substantial computational gains and accurate inference for large-scale spatiotemporal data on the sphere, enabling practical analysis at native grid resolutions.

Abstract

We propose a novel Bayesian framework for changepoint detection in large-scale spherical spatiotemporal data, with broad applicability in environmental and climate sciences. Our approach models changepoints as spatially dependent categorical variables using a multinomial probit model (MPM) with a latent Gaussian process, effectively capturing complex spatial correlation structures on the sphere. To handle the high dimensionality inherent in global datasets, we leverage stochastic partial differential equations (SPDE) and spherical harmonic transformations for efficient representation and scalable inference, drastically reducing computational burden while maintaining high accuracy. Through extensive simulation studies, we demonstrate the efficiency and robustness of the proposed method for changepoint estimation, as well as the significant computational gains achieved through the combined use of the MPM and truncated spectral representations of latent processes. Finally, we apply our method to global aerosol optical depth data, successfully identifying changepoints associated with a major atmospheric event.
Paper Structure (18 sections, 6 theorems, 72 equations, 4 figures, 5 tables)

This paper contains 18 sections, 6 theorems, 72 equations, 4 figures, 5 tables.

Key Result

Theorem 2.1

Assume $m_Z = 0$ and $\nu > 1/2.$ Define $v_Z := \sigma^2\sum_{l=0}^L (2l+1)(\kappa^2 + l(l+1))^{-\nu + 1}$ and $\Delta_{k,a}(z) := \min\left\{ \gamma_{\lfloor k+a,M \rfloor}-z,\; z-\gamma_{\lceil k-a-1,0 \rceil} \right\}$. The marginal distribution of the latent process $Z^L$ is given by $Z^L({\bf

Figures (4)

  • Figure 1: Boxplots of g-RMSE produced by MPM and IND under different mean shift values (1, 1.5 and 2.0) and changepoint correlation strength for (a) changepoints $\boldsymbol{\tau}_1$ generated by \ref{['eq:tau_method1']} and (b) changepoints $\boldsymbol{\tau}_2$ generated by \ref{['eq:tau_method2']}. The x-axis displays the mean shift signal, and the y-axis displays g-RMSE.
  • Figure 2: Fitted g-RMSE$(\hat{\boldsymbol{\tau}}^L)$ as a function of $L$ using \ref{['eq:exp']} for different mean shift values $\{1, 1.5, 2\}$. The boxplots represent the observed g-RMSE$(\hat{\boldsymbol{\tau}}^L)$ across 100 simulations. The red line represents estimated g-RMSE$(\hat{\boldsymbol{\tau}}).$
  • Figure 3: (a) Heatmap of detected changepoints in stratospheric AOD data. White color indicates that no changepoints were detected. (b) Time series of locations where no changepoints were detected. Grey lines represent time series of locations with changepoints detected.
  • Figure 4: Plot of $c_{sep}$ in the y-axis vs. $\xi_d$ in the x-axis for different values of $\kappa,\nu.$ Each curve represent different values of $\xi_r,$ distinguished by color.

Theorems & Definitions (15)

  • Theorem 2.1
  • Theorem 2.2
  • Definition A.1
  • Lemma A.1
  • proof
  • Definition A.2
  • Theorem A.2
  • proof
  • Proposition B.1
  • proof
  • ...and 5 more