Question
The following scenario tests your ability to summarise results, develop recommendations, and present findings in a concise manner. Product has run a A/B test as
The following scenario tests your ability to summarise results, develop recommendations, and present findings in a concise manner.
Product has run a A/B test as part of the customer registration flow and provided the below tables of results. The features were both run for 7 days and they've hypothesised that the "New Flow" would drive more registrations and purchases from new customers over the "Exisiting flow".
Provide an executive summary to discuss the performance of the A/B Test. Include any calculations deemed relevant such as Conversion Rate and ROI, Make recommendations based on the current set of data. You may highlight any further analysis, data required or testing you would recommend to support analysis.
First 7 Days Overview
Product Feature Test Group | Development Costs $ | New Registrations (first 7 days) | Number of customers who purchased (first 7 days) | Total Purchases ($) from New Registrations (first 7 days) |
---|---|---|---|---|
A Exisiting Flow | $ 100,000 | 50,000 | 20,000 | $ 250,000 |
B New Flow | $ 110,000 | 20,000 | 12,000 | $ 120,000 |
Step by Step Solution
There are 3 Steps involved in it
Step: 1
Get Instant Access to Expert-Tailored Solutions
See step-by-step solutions with expert insights and AI powered tools for academic success
Step: 2
Step: 3
Ace Your Homework with AI
Get the answers you need in no time with our AI-driven, step-by-step assistance
Get Started