Mixing
Calculate confidence-level in A/B-test on revenue
$begingroup$
I'm doing a split-test and need to calculate the confidence-level of the result. I need to implement the calculations on my own, not using any online-tools or excel.
I managed to do this for binomial values like the conversion rate, but couldn't get any further with non-binomial values like the revenue.
I have a lot of "old" data which I can use to calculate mean, variance, standard deviation and standard error specific for my data. I found some answers here, but (to be honsest) wasn't able to understand how to translate them into code. So any additional help is welcome.
statistics hypothesis-testing
asked Jan 29 at 15:05
WernerWerner
101
$endgroup$
add a comment |
$begingroup$
I'm doing a split-test and need to calculate the confidence-level of the result. I need to implement the calculations on my own, not using any online-tools or excel.
I managed to do this for binomial values like the conversion rate, but couldn't get any further with non-binomial values like the revenue.
I have a lot of "old" data which I can use to calculate mean, variance, standard deviation and standard error specific for my data. I found some answers here, but (to be honsest) wasn't able to understand how to translate them into code. So any additional help is welcome.
statistics hypothesis-testing
asked Jan 29 at 15:05
WernerWerner
101
$endgroup$
$begingroup$
Can you use R (downloadable and free)?
$endgroup$
– Henry
Jan 29 at 16:49
$begingroup$
Thanks for your reply. Unfortunately not: I need something that works on a webserver, like PHP. But I might be able to convert it to PHP if I see a solution in R or another language.
$endgroup$
– Werner
Jan 31 at 16:00
add a comment |
$begingroup$
I'm doing a split-test and need to calculate the confidence-level of the result. I need to implement the calculations on my own, not using any online-tools or excel.
I managed to do this for binomial values like the conversion rate, but couldn't get any further with non-binomial values like the revenue.
I have a lot of "old" data which I can use to calculate mean, variance, standard deviation and standard error specific for my data. I found some answers here, but (to be honsest) wasn't able to understand how to translate them into code. So any additional help is welcome.
statistics hypothesis-testing
asked Jan 29 at 15:05
WernerWerner
101
$endgroup$
I'm doing a split-test and need to calculate the confidence-level of the result. I need to implement the calculations on my own, not using any online-tools or excel.
I managed to do this for binomial values like the conversion rate, but couldn't get any further with non-binomial values like the revenue.
I have a lot of "old" data which I can use to calculate mean, variance, standard deviation and standard error specific for my data. I found some answers here, but (to be honsest) wasn't able to understand how to translate them into code. So any additional help is welcome.
statistics hypothesis-testing
statistics hypothesis-testing
asked Jan 29 at 15:05
WernerWerner
101
asked Jan 29 at 15:05
WernerWerner
101
asked Jan 29 at 15:05
WernerWerner
101
asked Jan 29 at 15:05
WernerWerner
101
asked Jan 29 at 15:05
WernerWerner
101
101
$begingroup$
Can you use R (downloadable and free)?
$endgroup$
– Henry
Jan 29 at 16:49
$begingroup$
Thanks for your reply. Unfortunately not: I need something that works on a webserver, like PHP. But I might be able to convert it to PHP if I see a solution in R or another language.
$endgroup$
– Werner
Jan 31 at 16:00
add a comment |
$begingroup$
Can you use R (downloadable and free)?
$endgroup$
– Henry
Jan 29 at 16:49
$begingroup$
Thanks for your reply. Unfortunately not: I need something that works on a webserver, like PHP. But I might be able to convert it to PHP if I see a solution in R or another language.
$endgroup$
– Werner
Jan 31 at 16:00
$begingroup$
Can you use R (downloadable and free)?
$endgroup$
– Henry
Jan 29 at 16:49
$begingroup$
Can you use R (downloadable and free)?
$endgroup$
– Henry
Jan 29 at 16:49
$begingroup$
Thanks for your reply. Unfortunately not: I need something that works on a webserver, like PHP. But I might be able to convert it to PHP if I see a solution in R or another language.
$endgroup$
– Werner
Jan 31 at 16:00
$begingroup$
Thanks for your reply. Unfortunately not: I need something that works on a webserver, like PHP. But I might be able to convert it to PHP if I see a solution in R or another language.
$endgroup$
– Werner
Jan 31 at 16:00
add a comment |
0
active
oldest
votes
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3092280%2fcalculate-confidence-level-in-a-b-test-on-revenue%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
0
active
oldest
votes
0
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3092280%2fcalculate-confidence-level-in-a-b-test-on-revenue%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
Can you use R (downloadable and free)?
$endgroup$
– Henry
Jan 29 at 16:49
$begingroup$
Thanks for your reply. Unfortunately not: I need something that works on a webserver, like PHP. But I might be able to convert it to PHP if I see a solution in R or another language.
$endgroup$
– Werner
Jan 31 at 16:00