Multiple McNemar Tests
Methods for performing multiple tests of paired proportions are described. A broadly applicable method using McNemar's exact test and the exact distributions of all test statistics is developed; the method controls the familywise error rate in the strong sense under minimal assumptions. A closed form (not simulation-based) algorithm for carrying out the method is provided. A bootstrap alternative is developed to account for correlation structures. Operating characteristics of these and other methods are evaluated via a simulation study. Applications to multiple comparisons of predictive models for disease classification and to postmarket surveillance of adverse events are given.
Document Type: Research Article
Affiliations: 1: Biostatistics and Bioinformatics Branch, Eunice Kennedy Shriver National Institute of Child Health and Human Development, Bethesda, Maryland 20892, U.S.A. 2: US Food and Drug Administration, Epidemiology Branch, Center for Devices and Radiological Health, HFZ-541, 1350 Piccard Drive, Rockville, Maryland 20850, U.S.A.
Publication date: 2010-12-01