Logo
ScienceStack
Table of Contents
Fetching ...
Sign In

Case Study: Performance Analysis of a Virtualized XRootD Frontend in Large-Scale WAN Transfers

J M da Silva, M A Costa, R L Iope

Abstract

This paper presents a detailed case study of the T2_BR_SPRACE storage frontend architecture and its observed performance in high-intensity data transfers. The architecture is composed of a heterogeneous cluster of XRootD [1] Virtual Machines (VMs) with 10 Gb/s and 40 Gb/s links, which aggregate data from a 77 Gb/s dCache [2] backend via pNFS to an external 100 Gb/s WAN link. We describe the system configuration, including the use of the BBR [3] congestion control algorithm and TCP extensions [4]. Under peak production conditions, we observed the system sustaining an aggregate throughput of 51.3 Gb/s. An analysis of a specific data flow to Fermilab (FNAL) showed peaks of 41.5 Gb/s, validated by external monitoring tools (CERN). This study documents the performance of a complex virtualized architecture under real load.

Case Study: Performance Analysis of a Virtualized XRootD Frontend in Large-Scale WAN Transfers

Abstract

This paper presents a detailed case study of the T2_BR_SPRACE storage frontend architecture and its observed performance in high-intensity data transfers. The architecture is composed of a heterogeneous cluster of XRootD [1] Virtual Machines (VMs) with 10 Gb/s and 40 Gb/s links, which aggregate data from a 77 Gb/s dCache [2] backend via pNFS to an external 100 Gb/s WAN link. We describe the system configuration, including the use of the BBR [3] congestion control algorithm and TCP extensions [4]. Under peak production conditions, we observed the system sustaining an aggregate throughput of 51.3 Gb/s. An analysis of a specific data flow to Fermilab (FNAL) showed peaks of 41.5 Gb/s, validated by external monitoring tools (CERN). This study documents the performance of a complex virtualized architecture under real load.
Paper Structure (12 sections, 4 figures, 3 tables)

This paper contains 12 sections, 4 figures, 3 tables.

Table of Contents

  1. Introduction
  2. Architecture and Configuration Description
  3. System Architecture
  4. Frontend Configuration (XRootD Servers)
  5. Backend Configuration (Disk I/O)
  6. Observed Results
  7. Aggregate Performance
  8. Peak WAN Flow Analysis (SPRACE $\rightarrow$ FNAL)
  9. Discussion
  10. Bottleneck Analysis
  11. Reliability Analysis
  12. Conclusion

Figures (4)

  • Figure 1: Storage cluster architecture.
  • Figure 2: Aggregate throughput.
  • Figure 3: Connection distribution.
  • Figure 4: CERN (FTS) monitoring validating the throughput peaks above 40 Gb/s in the analyzed period.