Test name

Segment
Test duration in days
Variation
A default
B variation

[Test name]
[Segment]
[# days]
Users
48,243
47,985

Conversions
2,446
2,631

CR
5.07%
5.48%

St. error
0.000999
0.001039

[Segment] | [Test name]

A default:

B variation:

2,446
conversions
+8.14%
0%

1%

2%

3%

4%

based on [# days] days of data, on average 48114 users per variation

* This A/B-test result visualization can only be used for an A versus B (split) test
* Created byAnnemarie Klaassen for Online Dialogue - September 2015
CR Verschil
8.14%
0.00%

B variation
A default

CR sign +
8.14%
Interval +
Interval -

CR ondergrens bovengrens
5.48%
5.24%
5.72%
5.07%
4.91%
5.23%

Confidencelevel
95%
90%
95%
90%

1 of 2-zijdig
1-tailed
1-tailed
2-tailed
2-tailed

CR niet sign

CR sign -

3.42%

Alpha
ke
0.05
0.1
0.05
0.1
st dev +
4.72%
12.86%

z-waarde
1.644853
1.281551
1.959964
1.644853
st dev o

5%

Confidence level
90%
1- or 2-tailed 2-tailed

Z-value

P-value CR Difference

2.86384

0.002

8.14%

Power
99.2%

Test information:

Test name: Fill out the name of the test in cell D3

Segment: In cell D4 fill out the segment you're ana

returning visitors, desktop or tablet users

Test duration: Fill out the number of days your tes

Settings:
2.9

Confidence level: Choose the level of confidence i

there's a 90% or 95% chance that the results you m
actual differences between Group A and Group B, a

1- or 2-sided: Choose whether you also want to kn

performs significantly worse (2-tailed) or not (1-taile

Test name]

Test statistics:

4%

5%

6%

7%

8%

9%

Questions? Contact @AM_Klaassen

Dev.
4.72%
4.54%

2.30279
1.64485
0.05

5.30%

p
2.303
1.794
2.744
2.303
stdev -

0.05
0.1
0.025
5.00%

4.874397%

Users: In cell D10 and D11 fill out the number of us

variations

Conversions: Fill out the number of conversions fo

E10 en E11. If you want to change the name 'conve
'transactions' or 'Add to carts' you can do so in cell

me of the test in cell D3

ut the segment you're analyzing; e.g. new or

or tablet users
number of days your test has run in cell D5

e the level of confidence in cell K3. This means

nce that the results you measured are due to
n Group A and Group B, and not to chance.

ether you also want to know if the variation

se (2-tailed) or not (1-tailed) in cell K5

1 fill out the number of users in each of the

number of conversions for each variation in cell

change the name 'conversions' to e.g.
rts' you can do so in cell E9

. new or

n cell D5

This means
re due to
hance.

ariation
K5

h of the

ation in cell
e.g.