Sign Test
Consider the set of paired observations (X1, Y1), (X2, Y2), ...., (Xn, Yn).
Let p = P(Yi > Xi). To find out if the values of the Yi's are probabilistically higher than its paired Xi value, we would design a sample test with the null hypothesis
Ho : p = 0.5
The null hypothesis states that the values of the Yi's have the same probability of being higher than the corresponding Xi value as they do being lower than the Xi's. On the other hand, the alternative hypothesis states that the values of the Yi's have a tendency to be higher (or lower) than the corresponding Xi value.
For each (Yi, Xi) observation, define the random variable Bi, where
Let B = (B1 + B2 + .... + Bn). Then the set of random variables B1, B2, ...., Bn vare independent Bernoulli variables with parameter p, and the random variable B is binomially distributed with parameters p and n. Therefore, if the null hypothesis is true, then B would have a binomial distribution with parameters p = 0.5 and n.
For large n, the test statistic
would have an approximately standard normal distribution (due to the central limit theorem). The following table shows the critical region of this sample test for various alternative hypothesis, using an a level of significance: