Robust In-the-Wild Exercise Recognition from a Single Wearable: Data-Side Fusion, Sensor Rotation, and Feature Engineering
Hoang Khang Phan, Khang Le, Tu Nhat Khang Nguyen, Anh Van Dao, Nhat Tan Le
TL;DR
This work tackles robust one-sensor exercise recognition under real-world sensor-placement variability by fusing contralateral limbs and applying axis inversion and sensor-rotation augmentations. It builds a large feature set from raw accelerometer data, signal magnitude vector representations, and angle-based measures, then uses a soft voting ensemble of HGBC and XGBoost, evaluated with group-5 cross-validation on the WEAR dataset. The approach yields macro-F1 around 58.8% overall (61.7% for arm, 55.95% for leg), with fractal/spectral features especially informative for arm movements and cross-limb fusion helping distinguish similar activities. The study highlights practical robustness in the wild, discusses current limitations, and proposes gyroscope integration and generative data synthesis as promising future directions; code is publicly available for reproduction.
Abstract
Monitoring physical exercises is vital for health promotion, with automated systems becoming standard in personal health surveillance. However, sensor placement variability and unconstrained movements limit their effectiveness. This study proposes the team "3KA"'s one-sensor workout activity recognition method using feature extraction and data augmentation in 2ndWEAR Dataset Challenge. From raw acceleration, angle and signal magnitude vector features were derived, followed by extraction of statistical, fractal/spectral, and higher-order differential features. A fused dataset combining left/right limb data was created, and augmented via sensor rotation and axis inversion. We utilized a soft voting model combining Hist Gradient Boosting with balanced weights and Extreme Gradient Boosting without. Under group 5-fold evaluation, the model achieved 58.83\% macro F1 overall (61.72% arm, 55.95% leg). ANOVA F-score showed fractal/spectral features were most important for arm-based recognition but least for leg-based. The code to reproduce the experiments is publicly available via: https://github.com/Khanghcmut/WEAR\_3K
