Table of Contents
Fetching ...

Robust Estimation of Polyserial Correlation

Max Welz

TL;DR

This work addresses estimating the polyserial correlation $\rho$ when the partially-latent normality assumption is violated for a fraction $\varepsilon$ of observations (partial misspecification). It introduces a robust estimator based on minimum density power divergence with tuning parameter $\alpha$, downweighting observations poorly described by the model and yielding weights that diagnose misspecification. The estimator is Fisher-consistent, consistent, and asymptotically normal, with near-ML efficiency under correct specification and practical computation (default $\alpha=0.5$ achieves substantial robustness with only modest efficiency loss). Implemented in the free R package $\texttt{robcat}$ and demonstrated on a personality-psychology dataset, the method identifies outliers and provides more reliable inference for mixed data in SEM-like analyses.

Abstract

The association between a continuous and an ordinal variable is commonly modeled through the polyserial correlation model. However, this model, which is based on a partially-latent normality assumption, may be misspecified in practice, due to, for example (but not limited to), outliers or careless responses. We demonstrate that the typically used maximum likelihood (ML) estimator is highly susceptible to such misspecification: One single observation not generated by partially-latent normality can suffice to produce arbitrarily poor estimates. As a remedy, we propose a novel estimator of the polyserial correlation model designed to be robust against the adverse effects of observations discrepant to that model. The estimator achieves robustness by implicitly downweighting such observations; the ensuing weights constitute a useful tool for pinpointing potential sources of model misspecification. We show that the proposed estimator generalizes ML and is consistent as well as asymptotically Gaussian. As price for robustness, some efficiency must be sacrificed, but substantial robustness can be gained while maintaining more than 98% of ML efficiency. We demonstrate our estimator's robustness and practical usefulness in simulation experiments and an empirical application in personality psychology where our estimator helps identify outliers. Finally, the proposed methodology is implemented in free open-source software.

Robust Estimation of Polyserial Correlation

TL;DR

This work addresses estimating the polyserial correlation when the partially-latent normality assumption is violated for a fraction of observations (partial misspecification). It introduces a robust estimator based on minimum density power divergence with tuning parameter , downweighting observations poorly described by the model and yielding weights that diagnose misspecification. The estimator is Fisher-consistent, consistent, and asymptotically normal, with near-ML efficiency under correct specification and practical computation (default achieves substantial robustness with only modest efficiency loss). Implemented in the free R package and demonstrated on a personality-psychology dataset, the method identifies outliers and provides more reliable inference for mixed data in SEM-like analyses.

Abstract

The association between a continuous and an ordinal variable is commonly modeled through the polyserial correlation model. However, this model, which is based on a partially-latent normality assumption, may be misspecified in practice, due to, for example (but not limited to), outliers or careless responses. We demonstrate that the typically used maximum likelihood (ML) estimator is highly susceptible to such misspecification: One single observation not generated by partially-latent normality can suffice to produce arbitrarily poor estimates. As a remedy, we propose a novel estimator of the polyserial correlation model designed to be robust against the adverse effects of observations discrepant to that model. The estimator achieves robustness by implicitly downweighting such observations; the ensuing weights constitute a useful tool for pinpointing potential sources of model misspecification. We show that the proposed estimator generalizes ML and is consistent as well as asymptotically Gaussian. As price for robustness, some efficiency must be sacrificed, but substantial robustness can be gained while maintaining more than 98% of ML efficiency. We demonstrate our estimator's robustness and practical usefulness in simulation experiments and an empirical application in personality psychology where our estimator helps identify outliers. Finally, the proposed methodology is implemented in free open-source software.
Paper Structure (45 sections, 1 theorem, 112 equations, 16 figures, 4 tables)

This paper contains 45 sections, 1 theorem, 112 equations, 16 figures, 4 tables.

Key Result

Theorem 1

Grant Assumption assumption. For fixed $\alpha \geq 0$, it holds true that as well as as $N\to\infty$, where The $d\times d$ matrices $\boldsymbol{J}\left( \bm{\theta}_0 \right)$ and $\boldsymbol{K}\left( \bm{\theta}_0 \right)$ are respectively defined in eq:Jmat and where is a $d$-vector, and both matrices are positive definite at $\bm{\theta}_0$.

Figures (16)

  • Figure 1: Simulated data where the polyserial model is misspecified for a fraction $\varepsilon = 0.15$ of the $N=10,000$ points. The gray dots are draws of $(X,\eta)$ from the polyserial model with true parameters $\rho = 0.5, \mu = 0, \sigma^2 = 1$, while the orange dots are draws from a contamination distribution $H_{X\eta}$, being a bivariate $t$-distribution here with noncentrality parameter $(10,-2)^\top$, scale matrix $\textnormal{diag}(0.25, 0.25)$, and 10 degrees of freedom. The horizontal lines mark the thresholds that discretize the latent $\eta$ to the observed ordinal $Y$ with five response options. The numbers in parentheses indicate the population marginal probability of the respective response option under the true polyserial model.
  • Figure 2: Boxplots of the bias of the considered estimators for the polyserial correlation coefficient, $\widehat{\rho}_N - \rho_*$ (top panel) and the point polyserial correlation coefficient with integer scoring, $\widehat{\widetilde{\rho}}_N - \widetilde{\rho}_*$ (bottom panel), for various contamination fractions in the misspecified polyserial models across 5,000 repetitions. Diamonds represent the respective average bias. The dotted lines at $\rho_* = -0.5$ and $-\widetilde{\rho}_* = -0.477$ indicate a sign flip in the respective estimate.
  • Figure 3: Histogram of the continuous variable stateanx (left) and response frequencies of the ordinal variable epilie (right) in the data of psychTools, for $N=231$ observations.
  • Figure 4: Weights $w_{i,\alpha}\left(\widehat{\bm{\theta}}_N\right), i = 1,\dots, N$, computed with the robust parameter estimates at tuning constants $\alpha = 0.5$, using the data in psychTools for the variables stateanx and epilie. For a clearer visualization, the $N=231$ weights are sorted here.
  • Figure 5: Estimates of the polyserial correlation coefficient for different values of tuning constant $\alpha$ ($\alpha = 0$ is MLE), computed on the variables stateanx and epilie in the data of psychTools.
  • ...and 11 more figures

Theorems & Definitions (1)

  • Theorem 1