A/b Testing

Build an experiment between two marketing stimuli and verify your hypothesis that one stimulus is better statistically than the other. Show your work. (Doesn't have to be real, It can be made up as long as you show your work)

Report describing the experiment and the results (incl. stat. test) along with your conclusion.

?EX: two different websites, two different Ads, two different CTA

Down below is an example , you can do the same experiment or choose a different one. if you shows to do Pepsi and Coke make sure your experiment is well describe and different (No bullet points). Must be a Convenient Sample 10 people.

An Example We want to test our Hypothesis that Pepsi is preferred to Coke by Millennials We will conduct a blind taste We need: Two solo cups Pepsi and Coke at same temperature A clip board with our survey, and a pencil We recruit 10 friends that all are Millennials (born 1981-96) - Convenient Sample Procedure In solo cup A we pour Pepsi without the participant seeing the brand In solo cup B we pour Coke without the participant seeing the brand The first 5 participants will first taste cup A then answer the survey question before tasting cup B and answering the survey question (Recency Bias) The next 5 participants will first taste cup B then answer the survey question before tasting cup A and answering the survey question Survey question: I like the taste of this beverage A. Strongly agree B. Agree C. Somewhat agree D. Neither agree nor disagree E. Somewhat disagree F. Disagree G. Strongly disagree Results Top 2 Box Method Pepsi 90% Strongly agree/agree Coke 20% Strongly agree/agree Lift = 70% MoE (n=10) = 31% CI Pepsi 90% +/- MoE 31% CI Coke 20% +/- MoE 31% Conclusion Participants preferred Pepsi 90% of the time versus Coke 20% of the time. The Lift or difference (70%) was statistically significant at a 95% confidence level given a margin of error of 31%. Millennials prefer Pepsi over Coke\f\f