Table of Contents
Fetching ...

A Beginner's Guide to Power and Energy Measurement and Estimation for Computing and Machine Learning

Akshaya Jagannadharao, Nicole Beckage, Sovan Biswas, Hilary Egan, Jamil Gafur, Thijs Metsch, Dawn Nafus, Giuseppe Raffa, Charles Tripp

TL;DR

The paper addresses the challenge of meaningfully measuring and interpreting energy use in ML workflows across diverse hardware and software environments. It delivers a practical framework—rooted in a simple energy-measurement workflow, multi-level measurement goals, and proxy strategies—for robust, comparable estimates, while highlighting common pitfalls such as idle power baselines, shared-resource effects, and measurement variability. Through scenario walkthroughs and tool guidance, it advocates for standardized reporting and methodological transparency to enable fair cross-system comparisons and informed design choices. The work aims to accelerate energy-aware ML by providing actionable guidance and motivating community standards for measurement and emissions reporting.

Abstract

Concerns about the environmental footprint of machine learning are increasing. While studies of energy use and emissions of ML models are a growing subfield, most ML researchers and developers still do not incorporate energy measurement as part of their work practices. While measuring energy is a crucial step towards reducing carbon footprint, it is also not straightforward. This paper introduces the main considerations necessary for making sound use of energy measurement tools and interpreting energy estimates, including the use of at-the-wall versus on-device measurements, sampling strategies and best practices, common sources of error, and proxy measures. It also contains practical tips and real-world scenarios that illustrate how these considerations come into play. It concludes with a call to action for improving the state of the art of measurement methods and standards for facilitating robust comparisons between diverse hardware and software environments.

A Beginner's Guide to Power and Energy Measurement and Estimation for Computing and Machine Learning

TL;DR

The paper addresses the challenge of meaningfully measuring and interpreting energy use in ML workflows across diverse hardware and software environments. It delivers a practical framework—rooted in a simple energy-measurement workflow, multi-level measurement goals, and proxy strategies—for robust, comparable estimates, while highlighting common pitfalls such as idle power baselines, shared-resource effects, and measurement variability. Through scenario walkthroughs and tool guidance, it advocates for standardized reporting and methodological transparency to enable fair cross-system comparisons and informed design choices. The work aims to accelerate energy-aware ML by providing actionable guidance and motivating community standards for measurement and emissions reporting.

Abstract

Concerns about the environmental footprint of machine learning are increasing. While studies of energy use and emissions of ML models are a growing subfield, most ML researchers and developers still do not incorporate energy measurement as part of their work practices. While measuring energy is a crucial step towards reducing carbon footprint, it is also not straightforward. This paper introduces the main considerations necessary for making sound use of energy measurement tools and interpreting energy estimates, including the use of at-the-wall versus on-device measurements, sampling strategies and best practices, common sources of error, and proxy measures. It also contains practical tips and real-world scenarios that illustrate how these considerations come into play. It concludes with a call to action for improving the state of the art of measurement methods and standards for facilitating robust comparisons between diverse hardware and software environments.

Paper Structure

This paper contains 37 sections, 3 figures, 4 tables.

Figures (3)

  • Figure 1: Steps for an Energy Measurement Project
  • Figure 2: The figure illustrates the progression from specific to broader scopes of energy measurement in computational contexts. Each color represents a distinct measurement scenario, connected in a logical sequence.
  • Figure 3: Example of a power to performance ratio for a specific study standard_performance_evaluation_corporation_specpower_ssj2008_2024.