13.21
McNemar's Test
McNemar's Test is a nonparametric statistical test used to determine if there is a significant difference in proportions between two related groups wh…
McNemar's test applies to paired nominal data presented in two-by-two contingency tables. This is a special case of randomized block design, where individuals are evaluated only twice.
For example, an ant species is evaluated in an experimental setting for its response to the artificial odor of its potential prey.
30 individuals are subjected to test arenas measuring 5 and 10 cm, one half of which is infused with the odor, and the other is a control.
The ants that move toward the odor are scored +, and the ones that move towards the control are scored -. Next, the two-by-two contingency table for 5 and 10 cm arenas is as follows.
Here, the null hypothesis is that the proportions in these two trials are the same, mathematically expressed as follows. If the change in the proportion between two trials is significant, the null hypothesis is rejected.
McNemar's test statistic is computed by the following expression.
As these values approximate chi-square distribution, the degree of freedom is one, and there is no evidence of any significant change in the behavioral response.
View the full transcript and gain access to JoVE Core videos
Q1: What type of data does McNemar's test analyze?
McNemar's test analyzes paired nominal data presented in two-by-two contingency tables. It applies to situations where individuals are evaluated twice under different conditions, such as pre-test and post-test designs. The test is ideal for binary outcomes like yes/no or success/failure responses measured in matched pairs.
Q2: When should you use McNemar's test instead of other statistical methods?
Use McNemar's test for paired samples with binary outcomes where the same subjects are measured under two different conditions. It is particularly suited for pre-post study designs, matched-pair studies, and clinical trials comparing treatment effectiveness. McNemar's test is a nonparametric alternative that does not assume normal distribution of data.
Q3: What are the key assumptions required for McNemar's test?
McNemar's test requires paired samples where each subject in one group corresponds to a subject in the other group. The outcome must be dichotomous (binary). Each pair must be independent of other pairs. Additionally, a minimum of 10 discordant pairs—where outcomes differ between conditions—is recommended for reliable results and adequate statistical power.
Q4: How is the McNemar's test statistic calculated?
McNemar's test statistic is computed using a specific formula based on the values in the two-by-two contingency table. The resulting test statistic approximates a chi-square distribution with one degree of freedom. If the calculated statistic exceeds the critical value, the null hypothesis is rejected, indicating a significant change in proportions between the two trials.
Q5: What does the null hypothesis state in McNemar's test?
The null hypothesis in McNemar's test states that the proportions in the two trials are the same. In other words, there is no significant difference in the binary outcome between the paired measurements. If the change in proportion between two trials is significant, the null hypothesis is rejected, suggesting a meaningful difference in the paired conditions.
Q6: Can McNemar's test be used with small sample sizes?
McNemar's test is relatively robust for small sample sizes compared to parametric tests. However, reliability decreases with very small samples. A minimum of 10 discordant pairs is generally recommended for meaningful results. With fewer discordant pairs, the test may lack sufficient statistical power to detect a true difference between the paired conditions.
Q7: What is an example application of McNemar's test in research?
A practical example involves evaluating ant behavior in response to artificial prey odor. Thirty ants are tested in two arena sizes, with each arena divided into an odor-infused section and a control section. Ants moving toward the odor are scored positive, while those moving toward the control are scored negative. McNemar's test determines whether behavioral response proportions differ significantly between the two arena sizes.