Using critical path analysis to model multimodal human–computer interaction

Authors: BABER C.¹; MELLOR B.²

Source: International Journal of Human-Computer Studies, Volume 54, Number 4, April 2001 , pp. 613-636(24)

Buy & download fulltext article:

Price: $52.63 plus tax (Refund Policy)

Abstract:

In this paper, the concept of multimodal human-computer interaction is explored. It is proposed that multimodality can be defined from human or technology perspectives, which place emphasis on different attributes of the system. Furthermore, in this paper it is argued that the most effective definition of multimodality concentrates on task and goal dependencies. Not only does this permit consideration over and above the technology/human distinction, but also allows consideration of multiple tasks. In order to explore this notion, critical path analysis is used to develop models of multimodal systems. The model describes multimodal HCI, and allows consideration of the effects of modality dependency. The models allow prediction of transaction time under various conditions. Predictions arising from these models are shown to be good fits with data obtained from user trials. Thus, it is proposed that one can develop and evaluate preliminary versions of multimodal systems prior to prototype development. Copyright 2001 Academic Press.

Keywords: user models; transaction time; critical path analysis; multimodal HCI.

Language: English

Document Type: Research article

Affiliations: 1: School of Electrical and Elecronic Engineering, The University of Birmingham, Birmingham, B15 2TT, UK 2: Speech Research Unit, DERA, Malvern, Worcester, UK

Publication date: 2001-04-01