Monte Carlo Analysis of Incomplete Paired-Comparison Experiments
The use of paired-comparison psychophysical experiments is an important technique that is used widely in imaging studies. It is sometimes difficult to compare every stimulus with every other; the number of paired comparisons for n stimuli becomes prohibitive for large values of n. Thus, experiments are often designed by missing some pairs. However, the effect on the accuracy of the estimations of the scale values is not clear. Similarly, if more resources are available, would it be better to recruit more observers making the same paired comparisons or to have the original observers carry out additional paired comparisons? This work seeks to develop a framework for addressing these practical questions surrounding incomplete paired-comparison experiment design. A Monte Carlo computational simulation is carried out with an ideal-observer model. Results suggest that the proportion of paired comparisons is more critical than the number of observers with small numbers of stimuli.
Document Type: Research Article
Publication date: 2014-09-01
The Journal of Imaging Science and Technology (JIST) is dedicated to the advancement of imaging science knowledge, the practical applications of such knowledge, and how imaging science relates to other fields of study. The pages of this journal are open to reports of new theoretical or experimental results, and to comprehensive reviews. Only original manuscripts that have not been previously published, nor currently submitted for publication elsewhere, should be submitted.
IS&T's JIST-first publication option allows authors wishing to present their work at conferences, but have a journal citation for their paper, to submit a paper to JIST that follows the same rigorous peer-review vetting and publication process as traditional JIST articles, but with the benefit of a condensed time-to-publication time frame and guaranteed conference presentation slot.
Please note: For purposes of its Digital Library content, IS&T defines Open Access as papers that will be downloadable in their entirety for free in perpetuity. Copyright restrictions on papers vary; see individual paper for details.
- Editorial Board
- Information for Authors
- Submit a Paper
- Subscribe to this Title
- Membership Information
- Information for Advertisers
- Terms & Conditions
- Information for JIST-First Authors
- Ingenta Connect is not responsible for the content or availability of external websites