A/B Testing - What are the conditions to declare the winner?
How To articles are not official guidelines or officially supported documentation. They are community-contributed content and may not always reflect the latest updates to Liferay DXP. We welcome your feedback to improve How To articles!
While we make every effort to ensure this Knowledge Base is accurate, it may not always reflect the most recent updates or official guidelines.We appreciate your understanding and encourage you to reach out with any feedback or concerns.
Legacy Article
You are viewing an article from our legacy "FastTrack"
publication program, made available for informational purposes. Articles
in this program were published without a requirement for independent
editing or verification and are provided"as is" without
guarantee.
Before using any information from this article, independently verify its
suitability for your situation and project.
Issue
-
In conducting A/B testing, all the tests were run in anonymous sessions, ensuring that each session was isolated by closing the incognito tab between tests.
-
I experimented with both anonymous and non-anonymous sessions to improve detection and differentiation on my local setup.
-
Despite recording multiple sessions, the test still shows no performance results or a declared winner.
-
Could we get insights into which of the four minimum requirements might still need to be met to progress the test?
Resolution
- There needs to be at least 5 sessions that visited the Control variation, and left the site.
- There needs to be at least 5 sessions that visited the Variation, and left the site.
- Please make sure to verify all the other requirements at Verifying A/B Test Requirements.
Did this article resolve your issue ?