Calculators

 

Fill in boxes #1 and #3 or boxes #1 and #2 to calculate sample size or significance of a test.



1. Response rate

%

2. Sample size


(total sample for test + control or the full multivariable test)
(sample for one test cell = 1/2 x this number)

3. Smallest Effect

Line of Significance

% LiftPercentage Pts
% %

(50/50 chance of seeing an effect this large - you may miss it)

80% Power

% LiftPercentage Pts % %

(80% chance that an effect this large will be significant - you will see it)

 
 

Fill in all White text fields for analyzing test results (A/B tests only - multivariable tests require deeper analysis)



Control

Number of contacts
Number of responses
Response Rate
+- Confidence Limits

Test

Number of contacts
Number of responses
Response Rate
+- Confidence Limits

Desired Confidence

Difference in response (test-control) and statistical significance

Effect (test-control)
+- Confidence limits (CL)
% Gain
High
Low

Significant Difference