A one-way ANOVA is used to determine whether or not there is a statistically significant difference between the means of three or more independent groups.
If the overall p-value from the ANOVA table is less than some significance level, then we have sufficient evidence to say that at least one of the means of the groups is different from the others.
However, this doesn’t tell us which groups are different from each other. It simply tells us that not all of the group means are equal.
In order to find out exactly which groups are different from each other, we must conduct a post hoc test.
One of the most commonly used post hoc tests is Tukey’s Test, which allows us to make pairwise comparisons between the means of each group while controlling for the family-wise error rate.
The following example shows how to perform Tukey’s Test in R.
Example: Tukey’s Test in SAS
Suppose a researcher recruits 30 students to participate in a study. The students are randomly assigned to use one of three studying methods to prepare for an exam.
The exam results for each student are shown below:
We can use the following code to create this dataset in SAS:
input Method $ Score;
Next, we’ll use proc ANOVA to perform the one-way ANOVA:
/*perform one-way ANOVA*/
proc ANOVA data=my_data;
model Score = Method;
means Method / tukey cldiff;
Note: We used the means statement along with the tukey and cldiff options to specify that a Tukey post-hoc test should be performed (with confidence intervals) if the overall p-value of the one-way ANOVA is statistically significant.
First, we’ll analyze the ANOVA table in the output:
From this table we can see:
- The overall F Value: 5.26
- The corresponding p-value: 0.0140
Recall that a one-way ANOVA uses the following null and alternative hypotheses:
- H0: All group means are equal.
- HA: At least one group mean is different from the rest.
Since the p-value from the ANOVA table (0.0140) is less than α = .05, we reject the null hypothesis.
This tells us that the mean exam score is not equal between the three studying methods.
To determine exactly which group means are different, we must refer to the final table in the output that shows the results of the Tukey post-hoc tests:
To tell which group means are different, we must look at which pairwise comparisons have stars (***) next to them.
From the table we can see there is a statistically significant difference in mean exam scores between group A and group C.
There are no statistically significant differences between any other group means.
The following tutorials provide additional information about ANOVA models: