Power Visualizer
See how low power inflates false positives, sign errors, and effect exaggeration.
%
%
Your Experiment
Incl. control
Abs. %
Rel. %
Total sample
Statistical Power & Errors
References
- Gelman, A. & Carlin, J. (2014). Beyond Power Calculations: Assessing Type S (Sign) and Type M (Magnitude) Errors. Perspectives on Psychological Science, 9(6), 641–651.
- Kohavi, R., Deng, A. & Vermeer, L. (2022). A/B Testing Intuition Busters: Common Misunderstandings in Online Controlled Experiments. KDD '22.
- Colquhoun, D. (2014). An investigation of the false discovery rate and the misinterpretation of p-values. Royal Society Open Science, 1(3).