Generalized Heterogeneous Functional Model with Applications to Large-scale Mobile Health Data
Xiaojing Sun, Bingxin Zhao, Fei Xue
TL;DR
This work tackles the challenge of time-varying, subgroup-specific effects of physical activity on diseases in large-scale mobile health data by introducing the Generalized Heterogeneous Functional Model (GHFM). GHFM jointly identifies subgroup structure and estimates subject-specific functional effects $\beta_{ij}(t)$ within a generalized scalar-on-function regression, employing a pairwise fusion penalty and a roughness penalty, with a scalable pre-clustering strategy and a hypothesis test for subgroup heterogeneity. The authors establish theoretical consistency for both coefficient estimation and subgroup identification and demonstrate strong performance in simulations versus homogeneous and competing mixture methods. In a large UK Biobank dementia study, GHFM detects three distinct subgroups with divergent time-varying effects of activity, improving predictive accuracy and offering interpretable, subgroup-specific guidance for interventions. The approach extends to Gaussian and binary outcomes, is scalable to very large datasets, and provides a practical framework for personalized, time-dependent health risk assessment.
Abstract
Physical activity is crucial for human health. With the increasing availability of large-scale mobile health data, strong associations have been found between physical activity and various diseases. However, accurately capturing this complex relationship is challenging, possibly because it varies across different subgroups of subjects, especially in large-scale datasets. To fill this gap, we propose a generalized heterogeneous functional method which simultaneously estimates functional effects and identifies subgroups within the generalized functional regression framework. The proposed method captures subgroup-specific functional relationships between physical activity and diseases, providing a more nuanced understanding of these associations. Additionally, we develop a pre-clustering method that enhances computational efficiency for large-scale data through a finer partition of subjects compared to true subgroups. We further introduce a testing procedure to assess whether the different subgroups exhibit distinct functional effects. In the real data application, we examine the impact of physical activity on the risk of dementia using the UK Biobank dataset, which includes over 96,433 participants. Our proposed method outperforms existing methods in future-day prediction accuracy, identifying three distinct subgroups, with detailed scientific interpretations for each subgroup. We also demonstrate the theoretical consistency of our methods. Codes implementing the proposed method are available at: https://github.com/xiaojing777/GHFM.
