Table of Contents
Fetching ...

Pseudo-label refinement using superpixels for semi-supervised brain tumour segmentation

Bethany H. Thompson, Gaetano Di Caterina, Jeremy P. Voisey

TL;DR

A framework based on superpixels - meaningful clusters of adjacent pixels - to improve the accuracy of the pseudo labels and address this issue is proposed, which is evaluated on a multimodal magnetic resonance imaging dataset for the task of brain tumour region segmentation.

Abstract

Training neural networks using limited annotations is an important problem in the medical domain. Deep Neural Networks (DNNs) typically require large, annotated datasets to achieve acceptable performance which, in the medical domain, are especially difficult to obtain as they require significant time from expert radiologists. Semi-supervised learning aims to overcome this problem by learning segmentations with very little annotated data, whilst exploiting large amounts of unlabelled data. However, the best-known technique, which utilises inferred pseudo-labels, is vulnerable to inaccurate pseudo-labels degrading the performance. We propose a framework based on superpixels - meaningful clusters of adjacent pixels - to improve the accuracy of the pseudo labels and address this issue. Our framework combines superpixels with semi-supervised learning, refining the pseudo-labels during training using the features and edges of the superpixel maps. This method is evaluated on a multimodal magnetic resonance imaging (MRI) dataset for the task of brain tumour region segmentation. Our method demonstrates improved performance over the standard semi-supervised pseudo-labelling baseline when there is a reduced annotator burden and only 5 annotated patients are available. We report DSC=0.824 and DSC=0.707 for the test set whole tumour and tumour core regions respectively.

Pseudo-label refinement using superpixels for semi-supervised brain tumour segmentation

TL;DR

A framework based on superpixels - meaningful clusters of adjacent pixels - to improve the accuracy of the pseudo labels and address this issue is proposed, which is evaluated on a multimodal magnetic resonance imaging dataset for the task of brain tumour region segmentation.

Abstract

Training neural networks using limited annotations is an important problem in the medical domain. Deep Neural Networks (DNNs) typically require large, annotated datasets to achieve acceptable performance which, in the medical domain, are especially difficult to obtain as they require significant time from expert radiologists. Semi-supervised learning aims to overcome this problem by learning segmentations with very little annotated data, whilst exploiting large amounts of unlabelled data. However, the best-known technique, which utilises inferred pseudo-labels, is vulnerable to inaccurate pseudo-labels degrading the performance. We propose a framework based on superpixels - meaningful clusters of adjacent pixels - to improve the accuracy of the pseudo labels and address this issue. Our framework combines superpixels with semi-supervised learning, refining the pseudo-labels during training using the features and edges of the superpixel maps. This method is evaluated on a multimodal magnetic resonance imaging (MRI) dataset for the task of brain tumour region segmentation. Our method demonstrates improved performance over the standard semi-supervised pseudo-labelling baseline when there is a reduced annotator burden and only 5 annotated patients are available. We report DSC=0.824 and DSC=0.707 for the test set whole tumour and tumour core regions respectively.

Paper Structure

This paper contains 14 sections, 2 equations, 4 figures, 1 table, 1 algorithm.

Figures (4)

  • Figure 1: Semi-supervised pseudo-labelling segmentation pipeline with the proposed superpixel-based pseudo-label refinement step
  • Figure 2: Superpixel maps with sigma=1, compactness=0.01, $n_{segments}$ = 350 for patient 224. Red contour: WT GT boundary, Black contour: TC GT boundary (a) T1, (b) T1Gd, (c) T2 and (d) T2-FLAIR
  • Figure 3: The different MRI modalities present in BraTS. (a) native (T1), (b) post-contrast T1-weighted (T1Gd), (c) T2-weighted (T2), (d) T2 Fluid Attenuated Inversion Recovery (T2-FLAIR), (e) original BraTS annotations, (f)-(h) region-based annotations: whole tumour (blue), tumour core (green), enhancing tumour (yellow)
  • Figure 4: Pseudo-label refinement for patient 224 after 200 epochs training (a) FLAIR image (b) network-inferred pseudo-label (c) pseudo-label post 3-D superpixel refinement and (d) GT label