CD-Raft: Reducing the Latency of Distributed Consensus in Cross-Domain Sites

TL;DR

CD-Raft is proposed to address the cross-domain latency challenge, an optimized Raft protocol for strong consistency in cross-domain sites, and can significantly reduce consensus latency by optimizing cross-domain round-trip time (RTT) for reads and writes, as well as carefully positioning the leader node.

Abstract

Today's massive AI computation loads push heavy data synchronization across sites, i.e., nodes in data centers. Any reduction in such consensus latency can significantly improve the overall performance of desired systems. This consensus challenge explosively peaks at cross-domain sites. In this paper, we proposed CD-Raft to address the cross-domain latency challenge, an optimized Raft protocol for strong consistency in cross-domain sites. CD-Raft can significantly reduce consensus latency by optimizing cross-domain round-trip time (RTT) for reads and writes, as well as carefully positioning the leader node. We verified the correctness of CD-Raft in a formal specification using the TLA+ specification, guaranteeing the strong consistency across sites. We have prototyped CD-Raft and evaluated it using the YCSB benchmark. Empirical results show that compared to the classic Raft, CD-Raft reduces the average latency by 32.90% and (99th percentile) tail latency by 49.24% for renown traces across multiple sites.

Figures (12)

• Figure 1: The write flow of Raft.
• Figure 2: The read flow of Raft.
• Figure 3: Write request processing flow of leader-based consensus protocol in cross-domain sites.
• Figure 4: The architecture of CD-Raft.
• Figure 5: The communication flow of CD-Raft.