Dynamic Composition of Information Retrieval Techniques

Authors: Arnt A.¹; Zilberstein S.²; Allan J.³; Mouaddib A-I.⁴

Source: Journal of Intelligent Information Systems, Volume 23, Number 1, July 2004 , pp. 67-97(31)

Publisher: Springer

Buy & download fulltext article:

Price: $47.00 plus tax (Refund Policy)

Abstract:

This paper presents a new approach to information retrieval (IR) based on run-time selection of the best set of techniques to respond to a given query. A technique is selected based on its projected effectiveness with respect to the specific query, the load on the system, and a time-dependent utility function. The paper examines two fundamental questions: (1) can the selection of the best IR techniques be performed at run-time with minimal computational overhead? and (2) is it possible to construct a reliable probabilistic model of the performance of an IR technique that is conditioned on the characteristics of the query? We show that both of these questions can be answered positively. These results suggest a new system design that carries a great potential to improve the quality of service of future IR systems.

Keywords: progressive processing; information retrieval; opportunity cost; meta-level control

Document Type: Research article

DOI: http://dx.doi.org/10.1023/B:JIIS.0000029671.27333.7d

Affiliations: 1: Department of Computer Science, University of Massachusetts, Amherst, MA 01003, USA., Email: arnt@cs.umass.edu 2: Department of Computer Science, University of Massachusetts, Amherst, MA 01003, USA., Email: shlomo@cs.umass.edu 3: Department of Computer Science, University of Massachusetts, Amherst, MA 01003, USA., Email: allan@cs.umass.edu 4: Département d'informatique, Université de Caen, 14032 Caen Cedex, France., Email: mouaddib@info.unicaen.fr

Publication date: 2004-07-01