A Framework to Model ML Engineering Processes

TL;DR

This paper introduces a framework for modeling ML-based software development processes, built around a domain-specific language and derived from an analysis of scientific and gray literature.

Abstract

The development of Machine Learning (ML) based systems is complex and requires multidisciplinary teams with diverse skill sets. This may lead to communication issues or misapplication of best practices. Process models can alleviate these challenges by standardizing task orchestration, providing a common language to facilitate communication, and nurturing a collaborative environment. Unfortunately, current process modeling languages are not suitable for describing the development of such systems. In this paper, we introduce a framework for modeling ML-based software development processes, built around a domain-specific language and derived from an analysis of scientific and gray literature. A supporting toolkit is also available.

Figures (19)

• Figure 1: ML workflow and DevOps process integration, from LwakatareTamburri.
• Figure 2: The components of the framework and its toolkit.
• Figure 3: Generic elements of an activity.
• Figure 4: An excerpt of the artifacts and resources hierarchy.
• Figure 5: The AI-specific role hierarchy.