Neural Functional Alignment Space: Brain-Referenced Representation of Artificial Neural Networks

TL;DR

The Neural Functional Alignment Space (NFAS), a brain-referenced representational framework for characterizing artificial neural networks on equal functional grounds, is proposed and suggests that representation dynamics provide a principled basis for cross-model consistency at the modality level.

Abstract

We propose the Neural Functional Alignment Space (NFAS), a brain-referenced representational framework for characterizing artificial neural networks on equal functional grounds. NFAS departs from conventional alignment approaches that rely on layer-wise features or task-specific activations by modeling the intrinsic dynamical evolution of stimulus representations across network depth. Specifically, we model layer-wise embeddings as a depth-wise dynamical trajectory and apply Dynamic Mode Decomposition (DMD) to extract the stable mode. This representation is then projected into a biologically anchored coordinate system defined by distributed neural responses. We also introduce the Signal-to-Noise Consistency Index (SNCI) to quantify cross-model consistency at the modality level. Across 45 pretrained models spanning vision, audio, and language, NFAS reveals structured organization within this brain-referenced space, including modality-specific clustering and cross-modal convergence in integrative cortical systems. Our findings suggest that representation dynamics provide a principled basis for

Figures (4)

• Figure 1: Overview of the Neural Functional Alignment Space Framework
• Figure 2: Structured Geometry of the Neural Functional Alignment Space.
• Figure 3: Modality-Specific Cortical Distribution of SNCI.
• Figure 4: Comparison of brain SNCI across functional networks.