Experimentation / CRO

Experimentation and Testing Programs acknowledge that the future is uncertain. These programs focus on getting better data to product and marketing teams to make better decisions.

UX / CX Research

Our research programs aim to characterize behaviors and perceptions of your core and adjacent customers.  Why? Because we want to change these behaviors and perceptions for the better.

Data and Analytics

90% of the analytics setups we’ve seen are critically flawed. Our data analytics audit services give you the confidence to make better decisions with data you can trust.

Multi Armed Vs A/B Testing

Multi Armed Vs A/B Testing

This framework is a guiding tool on when to run a multi-armed bandit vs. running a true A/B test. The general benefits are that A/B testing allows for a more statistically controlled learning environment, while MAB is more focused on generating a win as quickly as possible (at the sacrifice of understanding 'why')

Use Cases

Generally, this comes up when A/B testing may not have enough time to run (or traffic volume). Or, there is a seasonal campaign that is a one-off (with the above parameters) - so use this framework to help guide in the decision making process for when to MAB vs. run an A/B/n test

Type:
Ritual
Pillar:
Planning & Process