Talk:A/B testing

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search

Merge Proposal[edit]

This page should be merged with something like Experiment, as AB tests are experiments. Maybe something like a section explaining recent developments in the digital industry? Please refer also to the discussion in the archive. AB tests are the digital equivalent of Between-group_design and from the experimental design perspective there is nothing that deserves its own wikipedia page.

The rest of the story[edit]

I'm not asking a question for discussion here on the talk page, but rather asking for an article improvement.

Consider this scenario:

Web page "A" is seen by 100 people. 50 continue to purchase the product. But the analysis should not end there, because of the remaining 50, 25 come back the next week and purchase the product. Total sales: 75.

Web page "B" is seen by a different group of 100 people. 60 continue to purchase the product. Hurrah, page "B" is victorious! But the obnoxious aggressive advertising of page "B" is so annoying that the remaining 40 vow never to return. Total sales: 60.

How is this accounted for in A/B testing? 72.208.150.248 (talk) 15:54, 1 March 2017 (UTC)

You can set the sales as your conversion objective, so you'll see 75 conversions in Page A and 60 sales in page B, that's a matter of what you are meaning to optimize and it's very important to get this right, optimizing for the wrong metric can be very hurtful to your business.
--Sicarul (talk) 00:10, 1 July 2017 (UTC)

External links modified[edit]

Hello fellow Wikipedians,

I have just modified one external link on A/B testing. Please take a moment to review my edit. If you have any questions, or need the bot to ignore the links, or the page altogether, please visit this simple FaQ for additional information. I made the following changes:

When you have finished reviewing my changes, you may follow the instructions on the template below to fix any issues with the URLs.

As of February 2018, "External links modified" talk page sections are no longer generated or monitored by InternetArchiveBot. No special action is required regarding these talk page notices, other than regular verification using the archive tool instructions below. Editors have permission to delete the "External links modified" sections if they want, but see the RfC before doing mass systematic removals. This message is updated dynamically through the template {{sourcecheck}} (last update: 15 July 2018).

  • If you have discovered URLs which were erroneously considered dead by the bot, you can report them with this tool.
  • If you found an error with any archives or the URLs themselves, you can fix them with this tool.


Cheers.—InternetArchiveBot (Report bug) 19:16, 23 June 2017 (UTC)