Living with Ghosts

TL;DR

The paper addresses the ghost problem in higher-derivative gravity by studying a fourth-order scalar field within a Euclidean path-integral framework. By formulating states in terms of $\phi$ and $\\phi_{,\\tau}$ and tracing over $\\phi_{,\\tau}$ after Wick rotation, it shows that probabilities remain nonnegative and unitarity is effectively restored at low energies as the fourth-order term vanishes, despite nonunitary evolution of the full state. A higher-derivative harmonic oscillator illustrates that transition probabilities converge to the second-order theory in the $\alpha \to 0$ limit, supporting the physical viability of small fourth-order corrections. Runaways are avoided by Euclidean boundary conditions at the cost of slight causality violations, implying that fourth-order gravity can be consistent and potentially relevant in the early universe, while leaving standard low-energy predictions intact. Overall, the work challenges the notion that ghosts render higher-derivative gravity untenable and provides a concrete probabilistic framework for its quantum-consistent behavior.

Abstract

Perturbation theory for gravity in dimensions greater than two requires higher derivatives in the free action. Higher derivatives seem to lead to ghosts, states with negative norm. We consider a fourth order scalar field theory and show that the problem with ghosts arises because in the canonical treatment, $φ$ and $\Box φ$ are regarded as two independent variables. Instead, we base quantum theory on a path integral, evaluated in Euclidean space and then Wick rotated to Lorentzian space. The path integral requires that quantum states be specified by the values of $φ$ and $φ_{,τ}$. To calculate probabilities for observations, one has to trace out over $φ_{,τ}$ on the final surface. Hence one loses unitarity, but one can never produce a negative norm state or get a negative probability. It is shown that transition probabilities tend toward those of the second order theory, as the coefficient of the fourth order term in the action tends to zero. Hence unitarity is restored at the low energies that now occur in the universe.