MantisV2: Closing the Zero-Shot Gap in Time Series Classification with Synthetic Data and Test-Time Strategies

TL;DR

Methods that significantly strengthen zero-shot feature extraction for time series classification by introducing Mantis+, a variant of Mantis pre-trained entirely on synthetic time series and an enhanced test-time methodology that leverages intermediate-layer representations and refines output-token aggregation.

Abstract

Developing foundation models for time series classification is of high practical relevance, as such models can serve as universal feature extractors for diverse downstream tasks. Although early models such as Mantis have shown the promise of this approach, a substantial performance gap remained between frozen and fine-tuned encoders. In this work, we introduce methods that significantly strengthen zero-shot feature extraction for time series. First, we introduce Mantis+, a variant of Mantis pre-trained entirely on synthetic time series. Second, through controlled ablation studies, we refine the architecture and obtain MantisV2, an improved and more lightweight encoder. Third, we propose an enhanced test-time methodology that leverages intermediate-layer representations and refines output-token aggregation. In addition, we show that performance can be further improved via self-ensembling and cross-model embedding fusion. Extensive experiments on UCR, UEA, Human Activity Recognition (HAR) benchmarks, and EEG datasets show that MantisV2 and Mantis+ consistently outperform prior time series foundation models, achieving state-of-the-art zero-shot performance.

Figures (21)

• Figure 1: Final Performance on the UCR Benchmark.
• Figure 2: Random Crop Resize.
• Figure 3: Ablation study confirming the proposed Token Generator Unit.
• Figure 4: Ablation study on different hyperparameters of the architecture.
• Figure 5: Comparison of different transformer configurations.