Validation of the audience response system
Source: British Journal of Educational Technology, Volume 42, Number 6, 1 November 2011 , pp. 985-991(7)
Audience response systems (ARS) are gaining popularity in multiple areas of education. Although its usefulness has been well reported, no study has investigated the accuracy of the technology. The purpose of this study was to validate ARS by assessing three key aspects: signal transmission from the keypad to the receiver, capture of a proper response by the receiver and association of that response to the proper device. One hundred volunteers were assigned roles of responder or observer. Each responder was given a unique answer combination for a series of five questions. The data was assessed for accuracies and inaccuracies. Average correct response rate was 98% with a confidence interval (CI) ranging from 0.9527 to 0.9928 (CI = 0.95). The 2% incorrect response rate was attributable to failed signal transmission. These failed transmissions originated from different devices. As more institutions utilise ARS and as its use continues to expand into higher calibre arenas, validity of the system becomes of utmost importance. Given the relatively high confidence level of the system function, ARS is a valid and accurate method of response collecting, but one must certainly consider the possible ramifications of failed signal transmission.
Document Type: Research Article
Publication date: November 1, 2011