Hierarchical novel class discovery for single-cell transcriptomic profiles
Malek Senoussi, Thierry Artières, Paul Villoutreix
TL;DR
The paper tackles hierarchical Novel Class Discovery in single-cell transcriptomics where labeled and unlabeled label sets are disjoint. It introduces two hierarchy-aware clustering models, h-k-means and h-GMM, augmented with a hierarchical continuity loss that encourages smooth mean transitions along a cell lineage tree. Across simulated and experimental scRNA-seq datasets, the hierarchical methods generally improve clustering accuracy and approach an empirical upper bound, outperforming non-hierarchical baselines and remaining competitive with Autonovel in several settings. This work demonstrates that incorporating lineage structure into NCD for developmental data enhances both clustering and label mapping, with implications for scalable annotation in large-scale single-cell studies.
Abstract
One of the major challenges arising from single-cell transcriptomics experiments is the question of how to annotate the associated single-cell transcriptomic profiles. Because of the large size and the high dimensionality of the data, automated methods for annotation are needed. We focus here on datasets obtained in the context of developmental biology, where the differentiation process leads to a hierarchical structure. We consider a frequent setting where both labeled and unlabeled data are available at training time, but the sets of the labels of labeled data on one side and of the unlabeled data on the other side, are disjoint. It is an instance of the Novel Class Discovery problem. The goal is to achieve two objectives, clustering the data and mapping the clusters with labels. We propose extensions of k-Means and GMM clustering methods for solving the problem and report comparative results on artificial and experimental transcriptomic datasets. Our approaches take advantage of the hierarchical nature of the data.
