A Weak Signal Learning Dataset and Its Baseline Method
Xianqi Liu, Xiangru Li, Lefeng He, Ziyu Fang
TL;DR
This work tackles the challenge of weak signal learning by introducing the WSLD benchmark, a high-dimensional spectral dataset with dominant low-SNR samples and extreme class imbalance drawn from LAMOST data. It proposes the Parallel Dual-View Fusion Network (PDVFN), which jointly exploits a vector representation and a time-frequency representation via two specialized modules, ACR and PMTF, to capture local sequential features and global frequency-domain structures. The model is trained with a Gaussian-likelihood parameter loss ($L_{param}$) and a focal loss ($L_{focal}$) to handle uncertainty and imbalance, achieving state-of-the-art MAEs for multiple stellar-parameter regressions and superior classification metrics (AUC, F1, G-mean, MCC) on the WSLD. Overall, the dataset and PDVFN baseline provide a robust framework for advancing weak-signal perception in high-noise, imbalanced, and high-dimensional settings with practical impact in astronomical spectroscopy and beyond.
Abstract
Weak signal learning (WSL) is a common challenge in many fields like fault diagnosis, medical imaging, and autonomous driving, where critical information is often masked by noise and interference, making feature identification difficult. Even in tasks with abundant strong signals, the key to improving model performance often lies in effectively extracting weak signals. However, the lack of dedicated datasets has long constrained research. To address this, we construct the first specialized dataset for weak signal feature learning, containing 13,158 spectral samples. It features low SNR dominance (over 55% samples with SNR below 50) and extreme class imbalance (class ratio up to 29:1), providing a challenging benchmark for classification and regression in weak signal scenarios. We also propose a dual-view representation (vector + time-frequency map) and a PDVFN model tailored to low SNR, distribution skew, and dual imbalance. PDVFN extracts local sequential features and global frequency-domain structures in parallel, following principles of local enhancement, sequential modeling, noise suppression, multi-scale capture, frequency extraction, and global perception. This multi-source complementarity enhances representation for low-SNR and imbalanced data, offering a novel solution for WSL tasks like astronomical spectroscopy. Experiments show our method achieves higher accuracy and robustness in handling weak signals, high noise, and extreme class imbalance, especially in low SNR and imbalanced scenarios. This study provides a dedicated dataset, a baseline model, and establishes a foundation for future WSL research.
