Skip to main content
padlock icon - secure page this page is secure

Open Access Influence of Rater Training on Inter- and Intrarater Reliability When Using the Rat Grimace Scale

Download Article:
(PDF 105.6 kb)
Rodent grimace scales facilitate assessment of ongoing pain. Reported rater training using these scales varies considerably and may contribute to the observed variability in interrater reliability. This study evaluated the effect of training on interrater reliability with the Rat Grimace Scale (RGS). Two training sets (42 and 150 images) were prepared from acute pain models. Four trainee raters progressed through 2 rounds of training, scoring 42 images (set 1) followed by 150 images (set 2a). After each round, trainees reviewed the RGS and any problematic images with an experienced rater. The 150 images were then rescored (set 2b). Four years later, trainees rescored the 150 images (set 2c). A second group of raters (no-training group) scored the same image sets without review with the experienced rater. Inter- and intrarater reliability were evaluated by using the intraclass correlation coefficient (ICC), and ICC values were compared by using the Feldt test. In the trainee group, interrater reliability increased from moderate to very good between sets 1 and 2b and increased between sets 2a and 2b. Action units with the highest and lowest ICC at set 2b were orbital tightening and whiskers, respectively. In comparison to an experienced rater, the ICC for all trainees improved, ranging from 0.88 to 0.91 at set 2b. Four years later, very good interrater reliability was retained, and intrarater reliability was good or very good). The interrater reliability of the no-training group was moderate and did not improve from set 1 to set 2b. Training improved interrater reliability, with an associated reduction in 95%CI. In addition, training improved interrater reliability with an experienced rater, and performance was retained.

19 References.

No Supplementary Data.
No Article Media
No Metrics

Document Type: Research Article

Affiliations: 1: Western College of Veterinary Medicine, University of Saskatchewan, Saskatoon, Saskatchewan, Canada 2: Faculty of Veterinary Medicine, Université de Montréal, Saint-Hyacinthe, Québec, Canada 3: Faculty of Veterinary Medicine, Université de Montréal, Saint-Hyacinthe, Québec, Canada;, Email: [email protected]

Publication date: March 1, 2019

This article was made available online on February 12, 2019 as a Fast Track article with title: "Influence of Rater Training on Inter- and Intrarater Reliability When Using the Rat Grimace Scale".

More about this publication?
  • The Journal of the American Association for Laboratory Animal Science (JAALAS) serves as an official communication vehicle for the American Association for Laboratory Animal Science (AALAS). The journal includes a section of refereed articles and a section of AALAS association news. The mission of the refereed section of the journal is to disseminate high-quality, peer-reviewed information on animal biology, technology, facility operations, management, and compliance as relevant to the AALAS membership. JAALAS accepts research reports (data-based) or scholarly reports (literature-based), with the caveat that all articles, including solicited manuscripts, must include appropriate references and must undergo peer review.

    Attention Members: To access the full text of the articles, be sure you are logged in to the AALAS website.

    Attention: please note, due to a temporary technical problem, reference linking within the content is not available at this time

  • Editorial Board
  • Information for Authors
  • Submit a Paper
  • Subscribe to this Title
  • Membership Information
  • Information for Advertisers
  • For issues prior to 1997
  • Institutional Subscription Activation
  • Ingenta Connect is not responsible for the content or availability of external websites
  • Access Key
  • Free content
  • Partial Free content
  • New content
  • Open access content
  • Partial Open access content
  • Subscribed content
  • Partial Subscribed content
  • Free trial content
Cookie Policy
Cookie Policy
Ingenta Connect website makes use of cookies so as to keep track of data that you have filled in. I am Happy with this Find out more