Table of Contents
Fetching ...

A penalized heteroskedastic ordered probit model for DIF (measurement invariance) testing of single-item assessments in cross-cultural research

R Noah Padgett

Abstract

Differential item functioning (DIF) or measurement invariance (MI) testing for single-item assessments has previously been impossible. Part of the issue is that there are no conditioning variables to serve as a proxy for the latent variable--regression-based DIF methods. Another reason is that factor-analytic approaches require multiple items to estimate parameters. In this technical working paper, I propose an approach for evaluating DIF/MI in a single-item assessment of a construct. The current methods should NOT replace using multiple-indicator MG-CFA/IRT analyses of DIF/MI or regression mased methods when possible. More items generally provide significantly better construct coverage and provide more rigorous DIF/MI evaluation.

A penalized heteroskedastic ordered probit model for DIF (measurement invariance) testing of single-item assessments in cross-cultural research

Abstract

Differential item functioning (DIF) or measurement invariance (MI) testing for single-item assessments has previously been impossible. Part of the issue is that there are no conditioning variables to serve as a proxy for the latent variable--regression-based DIF methods. Another reason is that factor-analytic approaches require multiple items to estimate parameters. In this technical working paper, I propose an approach for evaluating DIF/MI in a single-item assessment of a construct. The current methods should NOT replace using multiple-indicator MG-CFA/IRT analyses of DIF/MI or regression mased methods when possible. More items generally provide significantly better construct coverage and provide more rigorous DIF/MI evaluation.
Paper Structure (8 sections, 12 equations, 3 figures)

This paper contains 8 sections, 12 equations, 3 figures.

Figures (3)

  • Figure 1: Item Happy--HETOP recovered latent means across countries by penalty with bounds at $\pm0.25$ for DIF across a range of penalty values.
  • Figure 2: Item Happy--HETOP recovered item discrimination parameters across countries by penalty with bounds at $\pm10$% for DIF across a range of penalty values.
  • Figure 3: Item characteristic curves for Happy--recovered from the HETOP model at penalty $\nu=1.0$.