Characterizing linguistic structure with mutual information

Authors: Pothos, Emmanuel M.¹; Juola, Patrick²

Source: British Journal of Psychology, Volume 98, Number 2, May 2007 , pp. 291-304(14)

Publisher: British Psychological Society

Key:

- Free Content

- New Content

- Subscribed Content

- Free Trial Content

Abstract:

We explore mutual information (MI) as a means of characterizing linguistic statistical structure. The MI between two linguistic tokens x and y is the degree to which seeing x helps us anticipate the occurrence of y. We computed MI between words in 595 samples of written text in 25 languages. Our analyses indicate that MI dependencies do not extend beyond a range of five words. Moreover, the similarity between MI profiles of different languages was used to cluster the languages. These results are discussed in terms of a putative link between short-term memory and linguistic structure and the further utility of MI in terms of characterizing the latter.

Document Type: Research article

DOI: 10.1348/000712606X122760

Affiliations: 1: Swansea University, UK 2: Duquesne University, Pittsburgh, USA

The full text electronic article is available for purchase. You will be able to download the full text electronic article after payment.

$24.40 plus tax Refund Policy