Skip to main content
Calkulon

Financie

Kalkulačka štatistickej významnosti A/B testu

A/B Test Significance

What is A/B Test Significance?

▾

Determines if A/B test results are statistically significant or due to chance. Critical for making confident product and marketing decisions.

Calkulon makes complex calculations simple — built for students and everyday problem-solvers.

How to A/B Test Significance

▾
  1. 1Define null hypothesis and significance level (typically 0.05)
  2. 2Calculate sample size needed for power
  3. 3Run A/B test long enough
  4. 4Calculate p-value using chi-square or t-test
  5. 5Accept or reject hypothesis

Worked Examples

▾
Example 1
Given:A 10%, B 12%
Výsledok:95% confidence

Frequently Asked Questions

▾
Q

What sample size do I need?

A

Depends on baseline rate and expected lift; typically 500-2,000 per variant for 80-90% statistical power.

Q

What's statistical significance?

A

95% confidence the result wasn't due to chance; p-value < 0.05 typically required.

Common Mistakes to Avoid

▾
  • !Stopping test too early when results favor variant
  • !Multiple testing inflating false positive rate
⭐

Did you know?

Testing one variant per week compounds improvements: 1% weekly = 37× improvement annually.

References

📖Difficulty:Advanced
Len na informačné účely. Tento nástroj nepredstavuje finančné poradenstvo. Pred investičnými alebo finančnými rozhodnutiami sa poraďte s kvalifikovaným finančným poradcom.
Formula-verified for precision
Reviewed October 2026
Our methodology

Ratings & comments

…

Získajte týždenné matematické tipy

Pridajte sa k 12 000+ odberateľom, ktorí každý týždeň dostávajú tipy na kalkulačku.

🔒
100% zadarmo
Nikdy bez registrácie
✓
Presné
Overené vzorce
⚡
Okamžité
Výsledky počas písania
📱
Vhodné pre mobily
Všetky zariadenia

Nastavenia