Although surveys routinely ask respondents to evaluate various aspects of their life on an ordered scale, there is concern about interpersonal comparability of these self-assessments. Statistically, the problem is one of identification in ordered response models with heterogeneous thresholds. As a solution to the identification problem, King et al. (2004) proposed using anchoring vignettes, namely brief descriptions of hypothetical people or situations that survey respondents are asked to evaluate on the same scale they use to rate their own situation. While vignettes have been introduced in several social surveys and are increasingly employed in a variety of fields, reliability of this approach hinges crucially on the validity of the assumptions of response consistency and vignette equivalence. This paper proposes a joint test of these key assumptions based on the fact that the underlying statistical model is overidentified if the two assumptions hold. Monte Carlo results show that the proposed test has good size and power properties in finite samples. We apply our test to self-assessment of pain using data from the first wave of the Survey of Health, Ageing and Retirement in Europe. We find that, when using only one of the three available vignettes, or when the test is carried out separately by subgroups of respondents, the overidentifying restrictions are less likely to be rejected.

The heterogeneous thresholds ordered response model: Identification and inference / Peracchi, F; Rossetti, Claudio. - In: JOURNAL OF THE ROYAL STATISTICAL SOCIETY. SERIES A. STATISTICS IN SOCIETY. - ISSN 0964-1998. - 3:176(2013), pp. 703-722. [10.1111/j.1467-985X.2012.01066.x]

The heterogeneous thresholds ordered response model: Identification and inference

ROSSETTI, CLAUDIO
2013

Abstract

Although surveys routinely ask respondents to evaluate various aspects of their life on an ordered scale, there is concern about interpersonal comparability of these self-assessments. Statistically, the problem is one of identification in ordered response models with heterogeneous thresholds. As a solution to the identification problem, King et al. (2004) proposed using anchoring vignettes, namely brief descriptions of hypothetical people or situations that survey respondents are asked to evaluate on the same scale they use to rate their own situation. While vignettes have been introduced in several social surveys and are increasingly employed in a variety of fields, reliability of this approach hinges crucially on the validity of the assumptions of response consistency and vignette equivalence. This paper proposes a joint test of these key assumptions based on the fact that the underlying statistical model is overidentified if the two assumptions hold. Monte Carlo results show that the proposed test has good size and power properties in finite samples. We apply our test to self-assessment of pain using data from the first wave of the Survey of Health, Ageing and Retirement in Europe. We find that, when using only one of the three available vignettes, or when the test is carried out separately by subgroups of respondents, the overidentifying restrictions are less likely to be rejected.
Ordered response models; Reporting heterogeneity; Minimum distance methods; Differential item functioning; Anchoring vignettes
The heterogeneous thresholds ordered response model: Identification and inference / Peracchi, F; Rossetti, Claudio. - In: JOURNAL OF THE ROYAL STATISTICAL SOCIETY. SERIES A. STATISTICS IN SOCIETY. - ISSN 0964-1998. - 3:176(2013), pp. 703-722. [10.1111/j.1467-985X.2012.01066.x]
File in questo prodotto:
File Dimensione Formato  
Peracchi, Rossetti (2013).pdf

Solo gestori archivio

Descrizione: Articolo principale
Tipologia: Documento in Post-print
Licenza: Tutti i diritti riservati
Dimensione 672.18 kB
Formato Adobe PDF
672.18 kB Adobe PDF   Visualizza/Apri
Pubblicazioni consigliate

Caricamento pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11385/85952
Citazioni
  • Scopus 17
  • ???jsp.display-item.citation.isi??? 16
social impact