Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Re-start A/B/C test on 'Start now' buttons #2411

Merged
merged 1 commit into from
Mar 30, 2016

Conversation

davidbasalla
Copy link
Contributor

Reverts #2337

For https://trello.com/c/KbYQzkNV/351-run-start-now-button-test-again-1

We ran a multivariate test for 'start now' buttons on 3 start pages (https://trello.com/c/GYqg2EEj) which was merged March 8 2016.

We want to run the test again to increase our confidence that the improvement trends shown in the original test are valid, with the same options winning and with a similar scale if difference. The original test was our first experiment and some of the data seems odd, so a chance to cross check the results is valuable.

We want to run the test for at least 14 days so that we can easily compare the results with those from the original test.

@floehopper
Copy link
Contributor

While I understand that you've used the default git revert commit note, I think it might be more helpful to use a custom commit note more like this:

Re-start abc test on start now buttons

Or even this:

Re-start A/B/C test on 'Start now' buttons

It would also be nice to update the PR title to match.

@floehopper
Copy link
Contributor

Otherwise this looks good to me.

@floehopper floehopper self-assigned this Mar 29, 2016
@davidbasalla davidbasalla changed the title Revert "Stop abc test on start now buttons" Re-start A/B/C test on 'Start now' buttons Mar 29, 2016
@davidbasalla davidbasalla force-pushed the revert-2337-stop-abc-test-for-start-now-buttons branch from b579572 to bbf4816 Compare March 29, 2016 16:58
This commit reverts #2337.
We ran a multivariate test for 'start now' buttons on 3 start pages in early March 2016. We want to run the test again to increase our confidence that the improvement trends shown in the original test are valid, with the same options winning and with a similar scale if difference.
@davidbasalla davidbasalla force-pushed the revert-2337-stop-abc-test-for-start-now-buttons branch from bbf4816 to 8c272d9 Compare March 29, 2016 17:04
@davidbasalla
Copy link
Contributor Author

Thank you for your comments @floehopper, have addressed and rebased.

@brenetic brenetic merged commit c8994da into master Mar 30, 2016
@brenetic brenetic deleted the revert-2337-stop-abc-test-for-start-now-buttons branch March 30, 2016 09:16
brenetic added a commit that referenced this pull request Apr 18, 2016
- This reverts the A/B/C 'Start now' button test from #2411
- This relates to the second round of multivariate test for 'start now' buttons
  on 3 start pages in early April 2016. This has now been completed.
brenetic added a commit that referenced this pull request Apr 18, 2016
- This reverts the A/B/C 'Start now' button test from #2411
- This relates to the second round of multivariate test for 'start now' buttons on 3 start pages in early April 2016. This has now been completed.
ikennaokpala pushed a commit that referenced this pull request Apr 20, 2016
- This reverts the A/B/C 'Start now' button test from #2411
- This relates to the second round of multivariate test for 'start now' buttons on 3 start pages in early April 2016. This has now been completed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants