Table of Contents
Fetching ...

Equivalence of Personalized PageRank and Successor Representations

Beren Millidge

TL;DR

Problem: unify memory retrieval and planning in the hippocampus. Approach: demonstrate that Personalized PageRank and the successor representation are isomorphic as the stationary distribution of a graph-walk, formalized through $\pi$ and the fixed-point equations. Key mapping: from $\pi = \alpha P \pi + (1-\alpha)p^*$ to $\pi^* = (I - \alpha P)^{-1}(1-\alpha)p^*$, identify $\gamma$ with $\alpha$, and $M = (I - \gamma \mathcal{T})^{-1}$ with $r = (1-\alpha)p^*$, placing the SR value function as $V(x) = M r(x)$. Significance: provides a unified, graph-based computational primitive for retrieval and planning across arbitrary graphs, with concrete neural and algorithmic predictions for hippocampal activity patterns.

Abstract

The hippocampus appears to implement two core but highly distinct functions in the brain: long term memory retrieval and planning and spatial navigation. Naively, these functions appear very different algorithmically. In this short note, we demonstrate that two powerful algorithms that have each independently been proposed to underlie the hippocampal operation for each function -- personalized page-rank for memory retrieval, and successor representations for planning and navigation, are in fact isomorphic and utilize the same underlying representation -- the stationary distribution of a random walk on a graph. We hypothesize that the core computational function of the hippocampus is to compute this representation on arbitrary input graphs.

Equivalence of Personalized PageRank and Successor Representations

TL;DR

Problem: unify memory retrieval and planning in the hippocampus. Approach: demonstrate that Personalized PageRank and the successor representation are isomorphic as the stationary distribution of a graph-walk, formalized through and the fixed-point equations. Key mapping: from to , identify with , and with , placing the SR value function as . Significance: provides a unified, graph-based computational primitive for retrieval and planning across arbitrary graphs, with concrete neural and algorithmic predictions for hippocampal activity patterns.

Abstract

The hippocampus appears to implement two core but highly distinct functions in the brain: long term memory retrieval and planning and spatial navigation. Naively, these functions appear very different algorithmically. In this short note, we demonstrate that two powerful algorithms that have each independently been proposed to underlie the hippocampal operation for each function -- personalized page-rank for memory retrieval, and successor representations for planning and navigation, are in fact isomorphic and utilize the same underlying representation -- the stationary distribution of a random walk on a graph. We hypothesize that the core computational function of the hippocampus is to compute this representation on arbitrary input graphs.
Paper Structure (5 sections, 6 equations)