The Importance of Item Selection in "Knew-It-All-Along" Studies of General Knowledge
Author: Winman A.1
Source: Scandinavian Journal of Psychology, Volume 38, Number 1, March 1997 , pp. 63-72(10)
Publisher: Blackwell Publishing
Abstract:
This study was designed to investigate the effects of item sampling on hindsight bias in experiments using general knowledge material. The results show that the use of random versus traditional experimenter-selected item samples can have different effects on hindsight bias. In a within-subjects study almost twice as many items in a random sample were connected with a reversed effect rather than with a traditional hindsight bias. The same items that resulted in overconfidence in foresight lead to a higher degree of hindsight bias than others. The results suggest that earlier findings of unusually large hindsight effects with general knowledge tasks may be explained by the selection of items used. No hindsight effect was found on confidence scores in a within-subjects design, but was obtained in a between-subjects design. Results suggest that the use of a within-subjects design itself can moderate hindsight bias by familiarizing subjects with the task. The study shows the importance of two conditions for decreasing the hindsight bias: (1) The use of randomly sampled items, and (2) The use of a within-subjects procedure. When these conditions were met, the "knew-it-all-along effect" was completely eliminated.
Keywords: Hindsight bias; knew-it-all-along effect; realism of confidence
Language: English
Document Type: Research article
DOI: 10.1111/1467-9450.00010
Affiliations: 1: Department of Psychology, Uppsala University, Sweden

Click here for Page Help