Skip to main content

A family of measures to evaluate scale reliability in a longitudinal setting

Buy Article:

$51.00 plus tax (Refund Policy)

Abstract:

Summary. 

The concept of reliability denotes one of the most important psychometric properties of a measurement scale. Reliability refers to the capacity of the scale to discriminate between subjects in a given population. In classical test theory, it is often estimated by using the intraclass correlation coefficient based on two replicate measurements. However, the modelling framework that is used in this theory is often too narrow when applied in practical situations. Generalizability theory has extended reliability theory to a much broader framework but is confronted with some limitations when applied in a longitudinal setting. We explore how the definition of reliability can be generalized to a setting where subjects are measured repeatedly over time. On the basis of four defining properties for the concept of reliability, we propose a family of reliability measures which circumscribes the area in which reliability measures should be sought. It is shown how different members assess different aspects of the problem and that the reliability of the instrument can depend on the way that it is used. The methodology is motivated by and illustrated on data from a clinical study on schizophrenia. On the basis of this study, we estimate and compare the reliabilities of two different rating scales to evaluate the severity of the disorder.

Keywords: Clinical trials; Hierarchical models; Longitudinal data; Rating scales; Reliability

Document Type: Research Article

DOI: https://doi.org/10.1111/j.1467-985X.2008.00554.x

Affiliations: 1: Hasselt University, Diepenbeek, Belgium 2: Tibotec, Johnson & Johnson, Mechelen, Belgium

Publication date: 2009-01-01

  • Access Key
  • Free content
  • Partial Free content
  • New content
  • Open access content
  • Partial Open access content
  • Subscribed content
  • Partial Subscribed content
  • Free trial content
Cookie Policy
X
Cookie Policy
Ingenta Connect website makes use of cookies so as to keep track of data that you have filled in. I am Happy with this Find out more