Table of Contents
Fetching ...

Neural Manifolds and Cognitive Consistency: A New Approach to Memory Consolidation in Artificial Systems

Phuong-Nam Nguyen

TL;DR

The paper addresses memory consolidation in artificial systems by unifying neural population dynamics, hippocampal SpWR-like replay, and cognitive consistency constraints within a low-dimensional manifold framework. It introduces a mathematical formalism where neural drift is captured on a manifold $\mathcal{M}$ and a balance energy $E_{\text{balance}}$ enforces coherent inter-neuronal interactions, with SpWR content weighted by balance-aware replay. Efficient algorithms for balance-energy computation and fast gradients are developed, and simulations show that cognition-inspired constraints improve interpretability and robustness while preserving performance. The approach aims to enable scalable neuromorphic architectures that harness structured replay and consistency principles for robust, adaptive learning in AI systems.

Abstract

We introduce a novel mathematical framework that unifies neural population dynamics, hippocampal sharp wave-ripple (SpWR) generation, and cognitive consistency constraints inspired by Heider's theory. Our model leverages low-dimensional manifold representations to capture structured neural drift and incorporates a balance energy function to enforce coherent synaptic interactions, effectively simulating the memory consolidation processes observed in biological systems. Simulation results demonstrate that our approach not only reproduces key features of SpWR events but also enhances network interpretability. This work paves the way for scalable neuromorphic architectures that bridge neuroscience and artificial intelligence, offering more robust and adaptive learning mechanisms for future intelligent systems.

Neural Manifolds and Cognitive Consistency: A New Approach to Memory Consolidation in Artificial Systems

TL;DR

The paper addresses memory consolidation in artificial systems by unifying neural population dynamics, hippocampal SpWR-like replay, and cognitive consistency constraints within a low-dimensional manifold framework. It introduces a mathematical formalism where neural drift is captured on a manifold and a balance energy enforces coherent inter-neuronal interactions, with SpWR content weighted by balance-aware replay. Efficient algorithms for balance-energy computation and fast gradients are developed, and simulations show that cognition-inspired constraints improve interpretability and robustness while preserving performance. The approach aims to enable scalable neuromorphic architectures that harness structured replay and consistency principles for robust, adaptive learning in AI systems.

Abstract

We introduce a novel mathematical framework that unifies neural population dynamics, hippocampal sharp wave-ripple (SpWR) generation, and cognitive consistency constraints inspired by Heider's theory. Our model leverages low-dimensional manifold representations to capture structured neural drift and incorporates a balance energy function to enforce coherent synaptic interactions, effectively simulating the memory consolidation processes observed in biological systems. Simulation results demonstrate that our approach not only reproduces key features of SpWR events but also enhances network interpretability. This work paves the way for scalable neuromorphic architectures that bridge neuroscience and artificial intelligence, offering more robust and adaptive learning mechanisms for future intelligent systems.

Paper Structure

This paper contains 25 sections, 33 equations, 4 figures.

Figures (4)

  • Figure 1: Interpretation of neural networks rnn
  • Figure 2: Graphical representation of Heider’s consistency theory: (Left) represents a balanced triad; (Right) represents an imbalanced triad.
  • Figure 3: Simulation of neural population dynamics and SpWR generation
  • Figure 4: Interpretation of neural networks: (Top) LSTM. (Bottom) GRU

Theorems & Definitions (10)

  • Definition 1: The Drive for Consistency
  • Definition 2: Neural population dynamics
  • Definition 3: Sequence replay
  • Definition 4: Trial Block Selection
  • Remark 1
  • Remark 2
  • Remark 3
  • Remark 4
  • Remark 5
  • Remark 6