Table of Contents
Fetching ...

Towards AI-Assisted Sustainable Adaptive Video Streaming Systems: Tutorial and Survey

Reza Farahani, Zoha Azimi, Christian Timmerer, Radu Prodan

TL;DR

This tutorial and survey addresses the environmental impact of video streaming by presenting a holistic review of AI-driven, energy-aware techniques across the entire lifecycle—from encoding and delivery to playback and VQA. It synthesizes 59 state-of-the-art works into a four-part taxonomy (encoding, delivery, playback, VQA) and discusses metrics, models, and benchmarks used to optimize energy without sacrificing QoE. The work highlights practical AI approaches (e.g., per-title/per-scene encoding, DRL-based ABR, edge caching, SR-based playback) and identifies gaps, notably in end-to-end energy modeling and the integration of generative AI, while outlining actionable research directions. Overall, the paper aims to guide researchers and practitioners toward designing sustainable adaptive streaming systems with measurable energy reductions and maintained or improved QoE.

Abstract

Improvements in networking technologies and the steadily increasing numbers of users, as well as the shift from traditional broadcasting to streaming content over the Internet, have made video applications (e.g., live and Video-on-Demand (VoD)) predominant sources of traffic. Recent advances in Artificial Intelligence (AI) and its widespread application in various academic and industrial fields have focused on designing and implementing a variety of video compression and content delivery techniques to improve user Quality of Experience (QoE). However, providing high QoE services results in more energy consumption and carbon footprint across the service delivery path, extending from the end user's device through the network and service infrastructure (e.g., cloud providers). Despite the importance of energy efficiency in video streaming, there is a lack of comprehensive surveys covering state-of-the-art AI techniques and their applications throughout the video streaming lifecycle. Existing surveys typically focus on specific parts, such as video encoding, delivery networks, playback, or quality assessment, without providing a holistic view of the entire lifecycle and its impact on energy consumption and QoE. Motivated by this research gap, this survey provides a comprehensive overview of the video streaming lifecycle, content delivery, energy and Video Quality Assessment (VQA) metrics and models, and AI techniques employed in video streaming. In addition, it conducts an in-depth state-of-the-art analysis focused on AI-driven approaches to enhance the energy efficiency of end-to-end aspects of video streaming systems (i.e., encoding, delivery network, playback, and VQA approaches). Finally, it discusses prospective research directions for developing AI-assisted energy-aware video streaming systems.

Towards AI-Assisted Sustainable Adaptive Video Streaming Systems: Tutorial and Survey

TL;DR

This tutorial and survey addresses the environmental impact of video streaming by presenting a holistic review of AI-driven, energy-aware techniques across the entire lifecycle—from encoding and delivery to playback and VQA. It synthesizes 59 state-of-the-art works into a four-part taxonomy (encoding, delivery, playback, VQA) and discusses metrics, models, and benchmarks used to optimize energy without sacrificing QoE. The work highlights practical AI approaches (e.g., per-title/per-scene encoding, DRL-based ABR, edge caching, SR-based playback) and identifies gaps, notably in end-to-end energy modeling and the integration of generative AI, while outlining actionable research directions. Overall, the paper aims to guide researchers and practitioners toward designing sustainable adaptive streaming systems with measurable energy reductions and maintained or improved QoE.

Abstract

Improvements in networking technologies and the steadily increasing numbers of users, as well as the shift from traditional broadcasting to streaming content over the Internet, have made video applications (e.g., live and Video-on-Demand (VoD)) predominant sources of traffic. Recent advances in Artificial Intelligence (AI) and its widespread application in various academic and industrial fields have focused on designing and implementing a variety of video compression and content delivery techniques to improve user Quality of Experience (QoE). However, providing high QoE services results in more energy consumption and carbon footprint across the service delivery path, extending from the end user's device through the network and service infrastructure (e.g., cloud providers). Despite the importance of energy efficiency in video streaming, there is a lack of comprehensive surveys covering state-of-the-art AI techniques and their applications throughout the video streaming lifecycle. Existing surveys typically focus on specific parts, such as video encoding, delivery networks, playback, or quality assessment, without providing a holistic view of the entire lifecycle and its impact on energy consumption and QoE. Motivated by this research gap, this survey provides a comprehensive overview of the video streaming lifecycle, content delivery, energy and Video Quality Assessment (VQA) metrics and models, and AI techniques employed in video streaming. In addition, it conducts an in-depth state-of-the-art analysis focused on AI-driven approaches to enhance the energy efficiency of end-to-end aspects of video streaming systems (i.e., encoding, delivery network, playback, and VQA approaches). Finally, it discusses prospective research directions for developing AI-assisted energy-aware video streaming systems.
Paper Structure (51 sections, 6 figures, 6 tables)

This paper contains 51 sections, 6 figures, 6 tables.

Figures (6)

  • Figure 1: Survey structure.
  • Figure 2: (a) Systematic literature review methodology, and (b) distribution of surveyed articles based on video streaming lifecycle segments across different years.
  • Figure 3: General video streaming life cycle, including video encoding, content delivery, and playback phases.
  • Figure 4: General AI-assisted video streaming workflow.
  • Figure 6: AI-based block partitioning example in HEVC codec.
  • ...and 1 more figures