If you repeatedly perform a hypothesis test when the null hypothesis is true, p-values will randomly drift between 0 and 1, and therefore, if you test often enough, you will always find a significant effect. lakens.github.io/statistical_i This is why preregistration is important. You can test multiple times as data comes in, but then you need to adjust the alpha level: lakens.github.io/statistical_i For a single simulation of the p-values you could get, see:

Sign in to participate in the conversation
CleverLibre Social

CleverLibre Social is an inclusive social instance for open discussion, learning, and community.
All cultures welcome.
Hate speech and harassment strictly forbidden.