Skip to main content
padlock icon - secure page this page is secure

Reliability procedures for categorical data in Performance Analysis


The full text article is not available for purchase.

The publisher only permits individual articles to be downloaded by subscribers.

A number of papers have discussed reliability assessment techniques but none have previously limited themselves to methods appropriate to the collection of categorical data on the nominal scale i.e. where events are recorded within defined categories, as in many instances for performance analysis. This paper makes a number of recommendations including the use of a gold standard coding to compare the typical analyst's codes against. Reliability measures should reflect the way in which the notation data is analysed so that assessments can be made regarding the extent to which each variable presented in the results was coded accurately. The Yule's Q statistic, based on the odds ratio, is recommended as the reliability statistic of choice for categorical data due to the intuitiveness of the measure, its ease of calculation and its apparent applicability to the decision making of performance analysts. Furthermore a value of 0.95 or above should be deemed an acceptable value to determine confidence in the analyst's ability to place an event into a category reliably.
No Reference information available - sign in for access.
No Citation information available - sign in for access.
No Supplementary Data.
No Article Media
No Metrics


Document Type: Research Article

Publication date: January 1, 2007

More about this publication?
  • Access Key
  • Free content
  • Partial Free content
  • New content
  • Open access content
  • Partial Open access content
  • Subscribed content
  • Partial Subscribed content
  • Free trial content
Cookie Policy
Cookie Policy
Ingenta Connect website makes use of cookies so as to keep track of data that you have filled in. I am Happy with this Find out more