Collegial verbalisation - a case study on a new method on information acquisition
Abstract:The purpose of this paper is to propose and discuss a new method for information acquisition called collegial verbalisation. The method is explored in an empirical case study, and it consists of vehicle operators being videotaped while driving, followed by some of their colleagues making verbal reports while watching the video data. These colleagues have previously experienced exactly the same driving task as the operators, that is, they have travelled the same route, with the same craft, and used the same instrumentation. Thus, they are very familiar with the driving task and the driver environment. The empirical study is carried out on a high-speed ferry. The method is explored in relation to three rather open hypotheses: the amount of information provided in general; the reliability of the data; and how it contributes to the detection of 'buggy mental models' within the operators. The method is discussed in relation to the more traditional forms of verbal reports: concurrent and retrospective verbalisations, respectively. From the results of the empirical exploration, it is suggested that the method of collegial verbalisation may have combinatorial advantages that makes it more powerful as an analytical tool than the traditional forms of verbalisation, specifically if one wants to analyse work tasks that are dynamic and where the operators' behaviours are highly automated. However, more elaborate and systematic investigations must be conducted on the topic, and the paper therefore ends with a suggestion on an experimental design for this purpose.
Document Type: Research Article
Affiliations: Department of Information Technology, Uppsala University, Uppsala, Sweden
Publication date: 2007-11-01