Authors: Arthur, Winfred¹; Glaze, Ryan M.¹; Villado, Anton J.¹; Taylor, Jason E.²

Source: International Journal of Selection and Assessment, Volume 18, Number 1, March 2010 , pp. 1-16(16)

Publisher: Wiley-Blackwell

Abstract:

The use of unproctored internet-based testing (UIT) for employee selection is quite widespread. Although this mode of testing has advantages over onsite testing, researchers and practitioners continue to be concerned about potential malfeasance (e.g., cheating and response distortion) under high-stakes conditions. Therefore, the primary objective of the present study was to investigate the magnitude and extent of high- and low-stakes retest effects on the scores of a UIT speeded cognitive ability test and two UIT personality measures. These data permitted inferences about the magnitude and extent of malfeasant responding. The study objectives were accomplished by implementing two within-subjects design studies ( Study 1N=296; Study 2N=318) in which test takers first completed the tests as job applicants (high-stakes) or incumbents (low-stakes) then as research participants (low-stakes). For the speeded cognitive ability measure, the pattern of test score differences was more consonant with a psychometric practice effect than a malfeasance explanation. This result is likely due to the speeded nature of the test. And for the UIT personality measures, the pattern of higher high-stakes scores compared with lower low-stakes scores is similar to those reported for proctored tests in the extant literature. Thus, our results indicate that the use of a UIT administration does not uniquely threaten personality measures in terms of elevated scores under high-stakes testing that are higher than those observed for proctored tests in the extant literature.

Document Type: Research article

DOI: http://dx.doi.org/10.1111/j.1468-2389.2010.00476.x

Affiliations: 1: Texas A&M University, College Station, TX, USA., Email: w-arthur@neo.tamu.edu 2: PeopleAnswers Inc., Addison, TX, USA

Publication date: 2010-03-01

Related content

• In this: publication
• By this: publisher
• In this Subject: Business
• By this author: Arthur, Winfred ;  Glaze, Ryan M. ;  Villado, Anton J. ;  Taylor, Jason E.

Website © Publishing Technology. Article copyright remains with the publisher, society or author(s) as specified within the article.

• Terms and conditions
• Privacy policy
• Information for advertisers