Experimentation / CRO

Experimentation and Testing Programs acknowledge that the future is uncertain. These programs focus on getting better data to product and marketing teams to make better decisions.

Research & Strategy

We believe that research is an integral part of experimentation. Our research projects aim to identify optimization opportunities by uncovering what really matters to your website users and customers.

Data and Analytics

90% of the analytics setups we’ve seen are critically flawed. Our data analytics audit services give you the confidence to make better decisions with data you can trust.

How to structure reporting across tests? Blueprint

How do I present ROI and customer learnings across tests for a program?

The structure of the database of test learnings is important for communicating to stakeholders and assuring that decisions and actions are documented correctly. It can be a cultural tool above all, as it is a recipe for changing culture, from a data foundation. Not just arm waving about the theoretical benefits of democratized decision making.

Use Cases:

LOTS to take away from this structure below. Most of the takeaways I'd think should effect how you communicate to stakeholders.

For example:

1. A loss can equal a save

2. A flat test can still be 'implemented' (a win, it confirmed smth)

3. It shows the emphasis on RELATIVE effects across tests, which isn't talked enough in our industry dialog. Accuracy is over rated IMO, Precision FTW.

4. A financial model is critical. Create a goal tree map, then do a model to translate this into relative potential revenue. Use for BOTH prioritization and for reporting like this. It changes the game.

5. But don't only present $ numbers, also pair EVERY TIME with customer learning sentences, to TLDR what it meant for your customer's behavior and/or perceptions.

Type:
Artifact
Pillar:
Decision & Execution
Get this Blueprint PDF
Get the Figma Toolkit
Toolkit includes PDF of the blueprint, links to related assets and a loom video on using the blueprint.

No spam - just the good stuff

Get this blueprint toolkit and the best of experimentation and CRO news delivered right into your mailbox, every week!
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.
Open Figma Toolkit Now
Toolkit includes PDF of the blueprint, and if available links to related assets and a loom video on using the blueprint.