Name: matched pair changes: the sign test
Uploaded: 2025-01-09T15:14:08.000Z
Duration: 1 min 17 s
Channel: JoVE

Consider the data on hamsters&#39; speed before and after administering a stimulant, which constitutes a matched pair. How does one test the claim that the stimulant impacts the hamster&#39;s speed?
Since the population distribution is unknown, the sign test&#8212;a nonparametric test&#8212;can be used.
The central concept of the sign test is that matched pairs with equal medians have approximately equal numbers of positive and negative signs.
First, convert the raw data into signs by subtracting the value of the second variable from the first variable. After excluding zeros, eight signs are obtained: three positive and five negative.
The null hypothesis posits that the median of the differences is zero, whereas the alternative hypothesis suggests otherwise.
Since n is less than 25, the test statistic x is the number of the less frequent sign. From the table, the critical value is zero at a significance level of 0.05.
Since the test statistic value is not less than or equal to the critical value, there is insufficient evidence to reject the claim that the median of the differences is zero.

sign test for matched pairs

Sign Test for Matched Pairs

The sign test for matched pairs offers a robust method for comparing two paired samples, often for the effects of an intervention in one of them. This method is very useful in situations where the underlying distribution of the data is unknown. The test compares two related samples&#8212;often pre- and post-treatment measurements on the same subjects&#8212;to determine if there are significant differences in their median values.
To conduct the sign test, we first calculate the differences in value between each pair of observations. The essence of the test lies in analyzing the signs (positive, negative, or zero) of these differences rather than their magnitudes. The process involves counting the number of positive and negative signs, disregarding any pairs where the difference is zero as they do not contribute to the conclusion of the test. In this case, the null hypothesis (H0) posits that the median difference between the matched pairs is zero, implying no effect from the treatment or intervention. Conversely, the alternative hypothesis (H1) suggests that the median difference is not equal to zero, indicating a significant effect of the treatment.
The outcome of the test is determined by the comparison of the count of the less frequent sign against a critical value from a pre-determined significance level, usually 0.05. If the count is less than or equal to the critical value, the result is statistically significant, leading to the rejection of the null hypothesis at a 95% confidence level. The sign test for matched pairs is particularly valuable for its simplicity and applicability to small sample sizes or when the normality of the distribution cannot be assumed, making it a versatile tool in statistical analysis.

Consider the data on hamsters&#39; speed before and after administering a stimulant, which constitutes a matched pair. How does one test the claim that ...

Education

JoVE Core

Statistics

Unit 1

Nonparametric Statistics

KEY TERMS AND CONCEPTS

matched pair changes: the sign test

The sign test for matched pairs compares two related samples. It is often used to check the effect of an intervention on one of the pairs. This method is useful when the data distribution is unknown. It is also helpful for small sample sizes.

The test usually looks at pre- and post-treatment measurements from the same subjects. It asks whether the median values of the two related samples are different. To do this, the differences between each pair of observations are calculated first. The test then uses the signs of those differences, not their sizes.

Each difference is marked as positive, negative, or zero. Pairs with a zero difference are left out because they do not affect the result. The null hypothesis, H0, says the median difference is zero, which means there is no effect from the treatment or intervention. The alternative hypothesis, H1, says the median difference is not equal to zero, which suggests a significant effect.

The result is found by comparing the smaller count of positive or negative signs with a critical value at a chosen significance level, usually 0.05. If the count is less than or equal to the critical value, the result is statistically significant. That means the null hypothesis is rejected at a 95% confidence level. Because it does not require normality, the sign test is a simple and versatile tool for statistical analysis.

Matched Pair Changes: The Sign Test

introduction to nonparametric statistics

Nonparametric Tests for Unusual Data

Nonparametric statistics are useful when data do not fit the usual assumptions for parametric tests. Parametric tests depend on a known population distribution and specific values such as the mean and standard deviation. Nonparametric tests do not require those conditions, so they are often used with small samples, skewed data, or ordinal and categorical variables. These methods are flexible because they work with data that do not meet requirements like normal distribution or equal variance.

ranks

Rank Ordering in Nonparametric Statistics

Rank ordering is a nonparametric statistics method that arranges data by a chosen criterion. It is useful for nominal and ordinal data, where values are grouped or ordered rather than measured on a scale. Because it needs fewer assumptions about the population, it is often easier to apply and interpret than parametric methods. To rank data, items are sorted first and then assigned a position. A set of weather days can be ordered from hottest to coldest, and cities can be arranged from smallest...

introduction to the sign test

Using the Sign Test for Paired Data

The sign test is a nonparametric statistics method for paired data, nominal data, and claims about a population median. It uses only the direction of change, so it does not rely on assumptions about the data distribution. That makes it useful when data do not fit the normal distribution requirements of many parametric tests. Researchers can use the sign test to compare two related measurements, such as pre- and post-treatment results in a medical study. In that example, a positive sign can...

The sign test for matched pairs compares two related samples. It is often used to check the effect of an intervention on one of the pairs. This method is useful when the data distribution is unknown. It is also helpful for small sample sizes. The test usually looks at pre- and post-treatment measurements from the same subjects. It asks whether the median values of the two related samples are different. To do this, the differences between each pair of observations are calculated first. The test...

sign test for nominal data

Testing Preferences with the Sign Test

The sign test is a nonparametric method for testing a single sample median or comparing the medians of two related samples. It is useful when the data are nominal, which means the values are categories such as names, labels, or preferences. Because nominal data do not have a natural order, analysis focuses on population proportions instead of mean or median values from continuous data. A simple example is a survey about pet preference. If some people choose dogs and others choose cats, the...

sign test for median of single population

sign-test-for-median-of-single-population

Single-Population Sign Test for a Median

The single-population sign test checks whether one sample median matches a chosen value. It is a nonparametric method, so it is useful when the data do not follow a known distribution. It is also helpful for small samples or when the usual assumptions for parametric tests are not met. The test starts with a null hypothesis that the population median equals a specific number. The alternative hypothesis can state that the median is different from, less than, or greater than that number. The...

wilcoxon signed-ranks test for matched pairs

wilcoxon-signed-ranks-test-for-matched-pairs

Testing Paired Data with Wilcoxon Signs

The Wilcoxon signed-rank test checks paired data by using both the size and the direction of the differences. It is a nonparametric test, which means it does not require the data to follow a normal distribution. It tests whether the median of the differences in a population of matched pairs is zero. This test works best when the data come in matched pairs, such as two measurements from the same subject or linked observations. The differences between each pair should also have an approximately...

wilcoxon signed-ranks test for median of single population

wilcoxon-signed-ranks-test-for-median-of-single-population

Wilcoxon Signed-Rank Test Using Ranked Differences

The Wilcoxon signed-rank test uses ranked differences to check whether a single population median matches a chosen value. It is a nonparametric test, so it does not require the data to follow a normal distribution. That makes it useful for small samples and for data that are not normal. The test starts by finding the difference, d, between each observation and the hypothesized median. The absolute values of those differences are then ranked from smallest to largest, and ties get the average...

wilcoxon rank-sum test

Comparing Two Groups with Rank Sums

The Wilcoxon rank-sum test compares two independent groups by using ranks instead of raw numbers. It is also called the Mann-Whitney U test. This nonparametric test helps show whether the two groups come from different distributions. The test is meant for two independent populations. The samples should be randomly drawn. The data must be ordinal, or it must be possible to put the data in order and rank it. The null hypothesis says the medians of the two populations are the same. The...

bootstrapping

Bootstrapping in Small Sample Statistics

Bootstrapping is a statistical resampling method used to estimate population parameters from an existing sample. It builds on the idea of the word bootstrap, which first appeared in the 19th century as a metaphor for doing something independently. In statistics, the method was developed by Dr. Bradley Efron in 1979. Bootstrapping is also called bootstrap resampling. It works by drawing many random samples, with replacement, from the original dataset. Each bootstrap sample has the same size as...

the anderson-darling test

Anderson-Darling Test for Goodness of Fit

The Anderson-Darling test checks whether a data sample fits a specific theoretical distribution. It compares the sample’s empirical cumulative distribution function, or ECDF, with the cumulative distribution function, or CDF, of the distribution being tested. This makes it a useful goodness-of-fit method when the population distribution is uncertain. Unlike parametric tests, the Anderson-Darling test does not require assumptions about specific distribution parameters. Its critical values...

spearman's rank correlation test

Using Ranks to Measure Correlation

Spearman's rank correlation test measures the link between two variables by using ranks instead of raw values. It is a nonparametric method, so it is useful when the data distribution is unknown or when the normality assumption does not hold. The test is also known as Spearman's rho and is named after Dr. Charles Edward Spearman, an English psychologist and statistician. This method acts as the nonparametric counterpart to Pearson's correlation coefficient. Pearson's correlation measures only...

kendall's tau test

Kendall Tau for Rank Correlation

Kendall's tau is a rank correlation test for checking whether two variables are related. It is also called the Kendall rank coefficient test. Because it is nonparametric, it can be used when the sample and population distributions are unknown. The test was developed in 1938 by British statistician Sir Maurice George Kendall. Its tau coefficient, written as τ, ranges from -1 to +1. A value of +1 means the two rankings are perfectly similar and show a strong positive correlation. A value of -1...

kruskal-wallis test

Kruskal-Wallis Test for Group Comparison

The Kruskal-Wallis test compares three or more independent groups when the data is not suited to a one-way ANOVA. It is a nonparametric test, which means it does not rely on the normal distribution needed for parametric methods. It is often used with one ordinal dependent variable, so it works well for ranked or ordered data. This test is useful when group data does not meet the assumption of equal variances or when the data shape is not normal. Instead of comparing means, the Kruskal-Wallis...

wald-wolfowitz runs test i

Runs Test for Randomness in Sequences

The Wald-Wolfowitz runs test checks whether the order of values in a sequence is random. It is also called the runs test. This nonparametric statistical test is used for ordered data, even when the population and sample distributions are not known. The method focuses on runs. A run is a continuous stretch of the same symbol, such as a series of positive values or a series of negative values. It can also be used with binary data, such as successes and failures, or with other two-category...

wald-wolfowitz runs test ii

Runs Test for Randomness in Ordered Data

The Wald-Wolfowitz runs test checks whether ordered data is random or shows a pattern. A run is a consecutive sequence of similar items. If the number of runs is much higher or lower than expected, the data is considered non-random and may contain a detectable structure. The test works with binary data such as + and −, or 1s and 0s. For data with two categories, the categories are first converted into binary choices. DNA sequences can be tested directly because categories like A, T, G, and C...

behrens&#8211;fisher test

Unequal-Variance Mean Comparison Test

The Behrens-Fisher test compares the means of two normally distributed populations when their variances are not equal. It is used when the usual Student’s t-test is not a good fit because that test assumes equal variances. This makes the Behrens-Fisher test useful for two independent samples that follow normality but do not share variance homogeneity. The method is especially helpful with small sample sizes. In that setting, unequal variances can affect how reliable the results are. The test...

fisher&#39;s exact test

Fisher's Exact Test for Small Tables

Fisher's exact test is a statistical significance test for 2x2 contingency tables. It is often used when sample sizes are small and the data are categorical. The test helps scientists check whether two variables may be related. Unlike the chi-squared test, Fisher's exact test does not estimate the P-value. It calculates the exact probability of seeing the observed data, or more extreme results, if the null hypothesis is true. That makes it useful when the chi-squared test assumptions are not...

friedman two-way analysis of variance by ranks

friedman-two-way-analysis-of-variance-by-ranks

Friedman Rank Test for Repeated Measures

Friedman’s Rank Test for Repeated Measures compares related data across several conditions when the usual ANOVA rules do not fit. It is a nonparametric test, so it works well with ordinal data or data that are not normally distributed. It is also useful for matched subjects over time or for repeated measures from the same group. The null hypothesis, H0, says that there is no difference in the distributions of the variables being compared. If H0 is rejected, the results show significant...

cochran's q test

Cochran's Q Test for Repeated Binary Data

Cochran's Q Test compares three or more related groups when the result is binary, meaning a yes/no or 0/1 outcome. It is a nonparametric statistical test, so it does not rely on a normal data pattern. Researchers use it to see whether the proportions differ across multiple conditions or time points for the same subjects. The test is an extension of the McNemar Test. McNemar's Test works with only two related samples, while Cochran's Q Test can handle three or more related samples. The test...

mcnemar's test

McNemar's Test for Paired Proportions

McNemar's Test compares paired proportions when the outcome has only two choices, such as yes/no, success/failure, or presence/absence. It is a nonparametric statistical test, so it is useful when the data come from related groups rather than independent groups. The test is often used with pre-test and post-test data, where the same subjects are measured under two conditions. The test is named after the statistician Quinn McNemar, who introduced it in 1947. It is commonly used in matched-pair...

kendall's coefficient of concordance

Ranking Agreement with Kendall's W

Kendall's Coefficient of Concordance, or Kendall's W, measures how much multiple raters agree when they rank the same set of items. It is a non-parametric statistic, so it works well with ordinal data, which are data written as ranks rather than exact measurements. This measure is useful when several judges or evaluators need to show whether their rankings are consistent. It is often used in research areas such as psychology, medicine, and social sciences. In those settings, people may be...

key terms and concepts

Learn how the sign test compares paired samples using positive and negative differences, with zero pairs removed and significance judged at the 0.05 level.

Matched Pair Changes: The Sign Test | JoVE K12

statistics

JoVE Core Statistics introduces the concepts and application of the collection, analysis, presentation, and interpretation of data to students. These animated lessons provide an understanding of statistics beneficial to students from a wide range of disciplines. Additionally, the scientist-in-action videos demonstrate the application of related concepts in classical and original research experiments performed in today's laboratories worldwide

Matched Pair Changes: The Sign Test

Description

Transcript

Tags