892: Null Hypothesis
Title text: Hell, my eighth grade science class managed to conclusively reject it just based on a classroom experiment. It's pretty sad to hear about million-dollar research teams who can't even manage that.
This comic is based on a misunderstanding. The null hypothesis is the hypothesis in a statistical analysis that indicates, essentially, the "status quo." For example, the null hypothesis for a study about cell phones and cancer risk might be "Cell phones have no effect on cancer risk." The alternative hypothesis, by contrast, is the one we want to prove or disprove - in this case, probably "Cell phones increase cancer risk."
After conducting a study, we can then make a judgement based on our data. There are statistical models for measuring the probability that a certain result occurred by random chance, even though in reality there is no correlation. If this probability is low enough (usually meaning it's below a certain threshold we set when we design the experiment, such as 1%), we reject the null hypothesis, in this case saying that cell phones do increase cancer risk. Otherwise, we accept the null hypothesis, saying that cell phones do not increase cancer risk. This is how almost all scientific experiments, from high school biology classes to CERN, produce results.
The main point to take away here is that "the null hypothesis" is a false notion, as it refers to a method of statistical analysis, not a specific hypothesis. Given that, Megan's response would probably be to facepalm.
- [A student works at a desk.]
- Cueball: I can't believe schools are still teaching kids about the null hypothesis.
- Cueball: I remember reading a big study that conclusively disproved it YEARS ago.