Table of Contents
Fetching ...

Artifact for A Non-Intrusive Framework for Deferred Integration of Cloud Patterns in Energy-Efficient Data-Sharing Pipelines

Sepideh Masoudi, Mark Edward Michael Daly, Jannis Kiesel

TL;DR

The paper tackles the challenge of reusing cloud-based transformation services across data-sharing pipelines in a Data Mesh by introducing SnapPattern, a Kubernetes-based tool that enables non-intrusive, deferred injection of cloud design patterns without modifying service code and while collecting energy metrics. The approach decouples pattern application from service implementations and supports energy-aware decisions, preserving service reusability. A case study with four Spring Boot transformation services demonstrates how patterns influence total energy consumption across multiple pipelines and showcases an extensible architecture and workflow for deployment, pattern injection, monitoring, and evaluation. The work contributes a practical, openly available tool for energy-efficient, pattern-enabled data pipelines in distributed environments, with a release under the MIT license.

Abstract

As data mesh architectures grow, organizations increasingly build consumer-specific data-sharing pipelines from modular, cloud-based transformation services. While reusable transformation services can improve cost and energy efficiency, applying traditional cloud design patterns can reduce reusability of services in different pipelines. We present a Kubernetes-based tool that enables non-intrusive, deferred application of design patterns without modifying services code. The tool automates pattern injection and collects energy metrics, supporting energy-aware decisions while preserving reusability of transformation services in various pipeline structures.

Artifact for A Non-Intrusive Framework for Deferred Integration of Cloud Patterns in Energy-Efficient Data-Sharing Pipelines

TL;DR

The paper tackles the challenge of reusing cloud-based transformation services across data-sharing pipelines in a Data Mesh by introducing SnapPattern, a Kubernetes-based tool that enables non-intrusive, deferred injection of cloud design patterns without modifying service code and while collecting energy metrics. The approach decouples pattern application from service implementations and supports energy-aware decisions, preserving service reusability. A case study with four Spring Boot transformation services demonstrates how patterns influence total energy consumption across multiple pipelines and showcases an extensible architecture and workflow for deployment, pattern injection, monitoring, and evaluation. The work contributes a practical, openly available tool for energy-efficient, pattern-enabled data pipelines in distributed environments, with a release under the MIT license.

Abstract

As data mesh architectures grow, organizations increasingly build consumer-specific data-sharing pipelines from modular, cloud-based transformation services. While reusable transformation services can improve cost and energy efficiency, applying traditional cloud design patterns can reduce reusability of services in different pipelines. We present a Kubernetes-based tool that enables non-intrusive, deferred application of design patterns without modifying services code. The tool automates pattern injection and collects energy metrics, supporting energy-aware decisions while preserving reusability of transformation services in various pipeline structures.

Paper Structure

This paper contains 9 sections, 3 figures, 6 tables.

Figures (3)

  • Figure 1: Class diagram of SnapPattern.
  • Figure 2: Workflow of using SnapPattern.
  • Figure 3: Side-by-side view of the experiment pipelines (left) and the tool’s GUI (right).