Integrating Distribution Matching into Semi-Supervised Contrastive Learning for Labeled and Unlabeled Data

TL;DR

This study aims to enhance pseudo-label-based SSL by incorporating distribution matching between labeled and unlabeled feature embeddings to improve image classification accuracy across multiple datasets.

Abstract

The advancement of deep learning has greatly improved supervised image classification. However, labeling data is costly, prompting research into unsupervised learning methods such as contrastive learning. In real-world scenarios, fully unlabeled datasets are rare, making semi-supervised learning (SSL) highly relevant in scenarios where a small amount of labeled data coexists with a large volume of unlabeled data. A well-known semi-supervised contrastive learning approach involves assigning pseudo-labels to unlabeled data. This study aims to enhance pseudo-label-based SSL by incorporating distribution matching between labeled and unlabeled feature embeddings to improve image classification accuracy across multiple datasets.

Figures (3)

• Figure 1: Overview of semi-supervised contrastive learning
• Figure 2: Pseudo Labeling ($p(\mathbf{z}_w^i)>\tau$)
• Figure 3: Pseudo Labeling ($p(\mathbf{z}_w^i)<\tau$), on CIFAR-10