Airavat: An Agentic Framework for Internet Measurement

TL;DR

Airavat is presented, the first agentic framework for Internet measurement workflow generation with systematic verification and validation, and generates workflows matching expert-level solutions and identifies methodological flaws missed by standard execution-based testing.

Abstract

Internet measurement faces twin challenges: complex analyses require expert-level orchestration of tools, yet even syntactically correct implementations can have methodological flaws and can be difficult to verify. Democratizing measurement capabilities thus demands automating both workflow generation and verification against methodological standards established through decades of research. We present Airavat, the first agentic framework for Internet measurement workflow generation with systematic verification and validation. Airavat coordinates a set of agents mirroring expert reasoning: three agents handle problem decomposition, solution design, and code implementation, with assistance from a registry of existing tools. Two specialized engines ensure methodological correctness: a Verification Engine evaluates workflows against a knowledge graph encoding five decades of measurement research, while a Validation Engine identifies appropriate validation techniques grounded in established methodologies. Through four Internet measurement case studies, we demonstrate that Airavat (i) generates workflows matching expert-level solutions, (ii) makes sound architectural decisions, (iii) addresses novel problems without ground truth, and (iv) identifies methodological flaws missed by standard execution-based testing.

Figures (10)

• Figure 1: Airavat’s architecture comprising a multi-agent workflow generation pipeline, verification engine, validation engine, knowledge graph, and registry.
• Figure 2: Country-level impact from SeaMeWe-5 cable failure. The heatmap shows the risk factor, computed as the fraction of IP addresses affected in a country relative to the total number of IP addresses mapped to that country. The results match the findings of Xaminer xaminer.
• Figure 3: Global cable infrastructure impact from earthquakes and hurricanes. The heatmap shows the risk factor, computed as the fraction of IP links affected in a country relative to the total number of IP links in that country. The results match the findings of Xaminer xaminer.
• Figure 4: A representative subset of the extraction for the Nautilus paper on submarine cable mapping. Continued in Figure \ref{['fig:kg_output_2']}
• Figure 5: Continued from Figure \ref{['fig:kg_output']} -- The representative subset of the extraction for the Nautilus paper on submarine cable mapping.