Optimal Signals and Detectors Based on Correlation and Energy
Yossi Marciano, Neri Merhav
TL;DR
This work generalizes likelihood-based detection to non-Gaussian noise by analyzing detectors based on correlation and energy under a Neyman–Pearson framework. It shows that for a fixed signal the optimal correlator is a low-complexity, at-most-three-point mapping, and that joint optimization drives the transmitted signal toward a balanced ternary form while tying the correlator to a three-point structure; allowing a linear combination with energy expands the parameter set to a five-parameter design, still solvable via Chernoff bounds and linear programming. The results provide explicit forms for the optimal test statistics and prove that the optimal joint signal-detector configurations remain highly structured and computationally feasible, with clear improvements in missed-detection exponents under FA constraints. The study also discusses extensions to broader noise models and potential applications to mismatched decoding in communications.
Abstract
In continuation of an earlier study, we explore a Neymann-Pearson hypothesis testing scenario where, under the null hypothesis ($\cal{H}_0$), the received signal is a white noise process $N_t$, which is not Gaussian in general, and under the alternative hypothesis ($\cal{H}_1$), the received signal comprises a deterministic transmitted signal $s_t$ corrupted by additive white noise, the sum of $N_t$ and another noise process originating from the transmitter, denoted as $Z_t$, which is not necessarily Gaussian either. Our approach focuses on detectors that are based on the correlation and energy of the received signal, which are motivated by implementation simplicity. We optimize the detector parameters to achieve the best trade-off between missed-detection and false-alarm error exponents. First, we optimize the detectors for a given signal, resulting in a non-linear relation between the signal and correlator weights to be optimized. Subsequently, we optimize the transmitted signal and the detector parameters jointly, revealing that the optimal signal is a balanced ternary signal and the correlator has at most three different coefficients, thus facilitating a computationally feasible solution.
