Skip to main content
padlock icon - secure page this page is secure

Analysing multisource feedback with multilevel structural equation models: Pitfalls and recommendations from a simulation study

Buy Article:

$52.00 + tax (Refund Policy)

When multisource feedback instruments, for example, 360‐degree feedback tools, are validated, multilevel structural equation models are the method of choice to quantify the amount of reliability as well as convergent and discriminant validity. A non‐standard multilevel structural equation model that incorporates self‐ratings (level‐2 variables) and others’ ratings from different additional perspectives (level‐1 variables), for example, peers and subordinates, has recently been presented. In a Monte Carlo simulation study, we determine the minimal required sample sizes for this model. Model parameters are accurately estimated even with the smallest simulated sample size of 100 self‐ratings and two ratings of peers and of subordinates. The precise estimation of standard errors necessitates sample sizes of 400 self‐ratings or at least four ratings of peers and subordinates. However, if sample sizes are smaller, mainly standard errors concerning common method factors are biased. Interestingly, there are trade‐off effects between the sample sizes of self‐ratings and others’ ratings in their effect on estimation bias. The degree of convergent and discriminant validity has no effect on the accuracy of model estimates. The χ 2 test statistic does not follow the expected distribution. Therefore, we suggest using a corrected level‐specific standardized root mean square residual to analyse model fit and conclude with further recommendations for applied organizational research.
No References
No Citations
No Supplementary Data
No Article Media
No Metrics

Keywords: convergent and discriminant validity; multilevel structural equation modelling; multisource feedback; multitrait–multimethod analysis; simulation study

Document Type: Research Article

Publication date: May 1, 2019

  • Access Key
  • Free content
  • Partial Free content
  • New content
  • Open access content
  • Partial Open access content
  • Subscribed content
  • Partial Subscribed content
  • Free trial content
Cookie Policy
Cookie Policy
Ingenta Connect website makes use of cookies so as to keep track of data that you have filled in. I am Happy with this Find out more