Agentic Federated Learning: The Future of Distributed Training Orchestration

Abstract

Although Federated Learning (FL) promises privacy and distributed collaboration, its effectiveness in real-world scenarios is often hampered by the stochastic heterogeneity of clients and unpredictable system dynamics. Existing static optimization approaches fail to adapt to these fluctuations, resulting in resource underutilization and systemic bias. In this work, we propose a paradigm shift towards Agentic-FL, a framework where Language Model-based Agents (LMagents) assume autonomous orchestration roles. Unlike rigid protocols, we demonstrate how server-side agents can mitigate selection bias through contextual reasoning, while client-side agents act as local guardians, dynamically managing privacy budgets and adapting model complexity to hardware constraints. More than just resolving technical inefficiencies, this integration signals the evolution of FL towards decentralized ecosystems, where collaboration is negotiated autonomously, paving the way for future markets of incentive-based models and algorithmic justice. We discuss the reliability (hallucinations) and security challenges of this approach, outlining a roadmap for resilient multi-agent systems in federated environments.

Figures (4)

• Figure 1: AgenticFL Paradigm: shows how an agent or a multi-agent system can be introduced into the pipeline.
• Figure 2: Pipeline of K-Agent
• Figure 3: Convergence of : The interval highlights the dynamic adaptation of the agent's strategy.
• Figure 4: Experiment comparing raw to random selection and ToolAgent.