Table of Contents
Fetching ...

A Survey on Transactional Stream Processing

Shuhao Zhang, Juan Soto, Volker Markl

TL;DR

This survey intends to introduce TSP and present its perspective on its future progression, to provide insights into the diverse TSP requirements and methodologies, and to inspire the design and development of groundbreaking TSP systems.

Abstract

Transactional stream processing (TSP) strives to create a cohesive model that merges the advantages of both transactional and stream-oriented guarantees. Over the past decade, numerous endeavors have contributed to the evolution of TSP solutions, uncovering similarities and distinctions among them. Despite these advances, a universally accepted standard approach for integrating transactional functionality with stream processing remains to be established. Existing TSP solutions predominantly concentrate on specific application characteristics and involve complex design trade-offs. This survey intends to introduce TSP and present our perspective on its future progression. Our primary goals are twofold: to provide insights into the diverse TSP requirements and methodologies, and to inspire the design and development of groundbreaking TSP systems.

A Survey on Transactional Stream Processing

TL;DR

This survey intends to introduce TSP and present its perspective on its future progression, to provide insights into the diverse TSP requirements and methodologies, and to inspire the design and development of groundbreaking TSP systems.

Abstract

Transactional stream processing (TSP) strives to create a cohesive model that merges the advantages of both transactional and stream-oriented guarantees. Over the past decade, numerous endeavors have contributed to the evolution of TSP solutions, uncovering similarities and distinctions among them. Despite these advances, a universally accepted standard approach for integrating transactional functionality with stream processing remains to be established. Existing TSP solutions predominantly concentrate on specific application characteristics and involve complex design trade-offs. This survey intends to introduce TSP and present our perspective on its future progression. Our primary goals are twofold: to provide insights into the diverse TSP requirements and methodologies, and to inspire the design and development of groundbreaking TSP systems.
Paper Structure (82 sections, 5 figures, 3 tables)

This paper contains 82 sections, 5 figures, 3 tables.

Figures (5)

  • Figure 1: Leaderboard Maintenance (LM) S-Store.
  • Figure 2: Streaming Ledger (SL) Transactions2018.
  • Figure 3: Taxonomy of TSP.
  • Figure 4: Example of timestamp assignment dilemma.
  • Figure 5: Illustrations of alternative system architectures of TSP systems.

Theorems & Definitions (8)

  • remark thmcounterremark: Beyond Exactly-Once Guarantee
  • definition thmcounterdefinition: Unified Transaction
  • definition thmcounterdefinition: Embedded Transaction
  • definition thmcounterdefinition: State Transaction
  • remark thmcounterremark: Failure of Concurrency Control Protocols
  • remark thmcounterremark: Timestamp Assignment Dilemma
  • remark thmcounterremark: TSP is not just nice to have, but sometimes a must
  • remark thmcounterremark: TSP-based applications have diverse requirements