Table of Contents
Fetching ...

Rediscovering Recurring Routing Results

Xiao Song, John Heidemann

TL;DR

Fenrir addresses the challenge of understanding and comparing Internet routing by representing service reachability as a routing vector $D(t)$ over networks and sites, and by measuring similarity with $(t,t')$ using $M(t,t',n)$ and Gower distance. It combines data-cleaning, weighting, pairwise similarity, and hierarchical clustering to identify recurring routing modes and quantify changes, with visualizations such as heatmaps and transition matrices $T(t,t',s,s')$ to guide operator decisions. The approach is validated against operator ground truth for B-Root and applied to five years of anycast data, USC traceroutes, and front-end website measurements (Google and Wikipedia), revealing stable modes, large enterprise upstream changes, and rapid front-end evolution by hypergiants. Fenrir thus offers a general, measurement-driven framework for operational routing awareness across multiple classes of Internet services, enabling operators to detect both self-initiated and third-party routing changes and their potential performance implications.

Abstract

Routing is central to networking performance, including: (1) latency in anycast services and websites served from multiple locations,(2) networking expenses and throughput in multi-homed enterprises, (3) the ability to keep traffic domestic when considering data sovereignty. However, understanding and managing how routing affects these services is challenging. Operators use Traffic Engineering (TE) with BGP to optimize network performance, but what they get is the result of all BGP policies throughout the Internet, not just their local choices. Our paper proposes Fenrir, a new system to rediscover recurring routing results. Fenrir can discover changes in network routing, even when it happens multiple hops away from the observer. Fenrir also provides new methods to quantify the degree of routing change, and to identify routing "modes" that may reappear. Second, we show that Fenrir can be applied to many different problems: we use five instances of three different types of systems to illustrate the generalization: anycast catchments showing in a root DNS service, route optimization for two multi-homed enterprises, and website selection for two of the top-10 web services. Each type requires different types of active measurements, data cleaning and weighting. We demonstrate Fenrir's methods of detecting and quantifying change are helpful because they all face similar operational questions: How much effect did traffic engineering have? Did a third-party change alter my routing? In either case, is the current routing new, or is it like a routing mode I saw before?

Rediscovering Recurring Routing Results

TL;DR

Fenrir addresses the challenge of understanding and comparing Internet routing by representing service reachability as a routing vector over networks and sites, and by measuring similarity with using and Gower distance. It combines data-cleaning, weighting, pairwise similarity, and hierarchical clustering to identify recurring routing modes and quantify changes, with visualizations such as heatmaps and transition matrices to guide operator decisions. The approach is validated against operator ground truth for B-Root and applied to five years of anycast data, USC traceroutes, and front-end website measurements (Google and Wikipedia), revealing stable modes, large enterprise upstream changes, and rapid front-end evolution by hypergiants. Fenrir thus offers a general, measurement-driven framework for operational routing awareness across multiple classes of Internet services, enabling operators to detect both self-initiated and third-party routing changes and their potential performance implications.

Abstract

Routing is central to networking performance, including: (1) latency in anycast services and websites served from multiple locations,(2) networking expenses and throughput in multi-homed enterprises, (3) the ability to keep traffic domestic when considering data sovereignty. However, understanding and managing how routing affects these services is challenging. Operators use Traffic Engineering (TE) with BGP to optimize network performance, but what they get is the result of all BGP policies throughout the Internet, not just their local choices. Our paper proposes Fenrir, a new system to rediscover recurring routing results. Fenrir can discover changes in network routing, even when it happens multiple hops away from the observer. Fenrir also provides new methods to quantify the degree of routing change, and to identify routing "modes" that may reappear. Second, we show that Fenrir can be applied to many different problems: we use five instances of three different types of systems to illustrate the generalization: anycast catchments showing in a root DNS service, route optimization for two multi-homed enterprises, and website selection for two of the top-10 web services. Each type requires different types of active measurements, data cleaning and weighting. We demonstrate Fenrir's methods of detecting and quantifying change are helpful because they all face similar operational questions: How much effect did traffic engineering have? Did a third-party change alter my routing? In either case, is the current routing new, or is it like a routing mode I saw before?
Paper Structure (32 sections, 7 equations, 8 figures, 4 tables)

This paper contains 32 sections, 7 equations, 8 figures, 4 tables.

Figures (8)

  • Figure 1: Catchment sizes in G-Root, as measured by counts of RIPE Atlas VPs (measurement id 10314). 2020-03-01 to 2020-03-09.
  • Figure 2: Enterprise catchments from 2024-08 to 2025-04 at hop 3. The routing change happens on 2025-01-16. Dataset: USC/traceroute.
  • Figure 3: B-Root catchments from 2019-09 to 2024-12. Dataset: B-Root/Verfploeter. Zoom in the rectangle 1 in \ref{['fig:broot_zoomed_in_2023']} to show latency changes.
  • Figure 4: The 90th percentile of latency of B-Root, from 2022-01-01 to 2023-12-31. Dataset: RIPE-Atlas
  • Figure 5: Heatmap of routing changes of Google, from 2013-05-26 to 2013-05-28 and from 2024-02-17 to 2024-04-21. Dataset: Google/EDNS-CS
  • ...and 3 more figures