DEMAU: Decompose, Explore, Model and Analyse Uncertainties

TL;DR

DEMAU is offered, an open-source educational, exploratory and analytical tool allowing to visualize and explore several types of uncertainty for classification models in machine learning.

Abstract

Recent research in machine learning has given rise to a flourishing literature on the quantification and decomposition of model uncertainty. This information can be very useful during interactions with the learner, such as in active learning or adaptive learning, and especially in uncertainty sampling. To allow a simple representation of these total, epistemic (reducible) and aleatoric (irreducible) uncertainties, we offer DEMAU, an open-source educational, exploratory and analytical tool allowing to visualize and explore several types of uncertainty for classification models in machine learning.

Figures (4)

• Figure 1: DEMAU interface
• Figure 2: Uncertainty for several models.
• Figure 3: Different uncertainty quantifications.
• Figure 4: Decomposition of uncertaintiy.