Hello ! A reviewer asks me to perform a post-hoc . I know this is generally not advised because if you replace the a priori effect size by the effect size measured in the experiment, this will introduce an erroneous relationship between the significance level of the test and the measured power.
... but does that mean that there is no proper way of measuring power retrospectively? For example, if you refrain from using the measured effect size and instead simulate a range of "a priori" effect size unrelated to the results of the test, then the dependency of the power to the significance level should not happen?
@lakens

@leovarnet @lakens Our thoughts:

Heinsberg LW, Weeks DE. Post hoc power is not informative. Genet Epidemiol. 2022 Oct;46(7):390-394.

pubmed.ncbi.nlm.nih.gov/356425

@StatGenDan This looks very relevant to my question indeed! Thank you!

Sign in to participate in the conversation
CleverLibre Social

CleverLibre Social is an inclusive social instance for open discussion, learning, and community.
All cultures welcome.
Hate speech and harassment strictly forbidden.