Author: Martin P.
Title: Content Marketer
EP 47: Cadence For Experimentation Meetings?
“Being in the same room with people and creating something together is a good thing.” – Robin Williams
Hey hey.
Martin P. from Speero here.
How good you are at accessing where is your experimentation program?
Spotting and taking care of weekly roadblocks or broken parts of the program’s flywheel itself?
What’s your quality standard for decisions?
This week’s blueprint deals with just that.
This Week in Experimentation:
Blueprint of the week: Cadence For Experimentation Meetings? — A clever little blueprint for pairing what you discuss and when you discuss it in weekly, monthly, and quarterly meetings. Link.
Talk of the week: Ayat Shukairy shares 7 CRO fundamentals she learned from analyzing over 22,000 AB tests on 700 different CRO projects. These ‘common patterns’ helped her team deliver upward of a 50% test success rate. Link.
Read of the week: How Eppo built a Snowflake-native experimentation platform based on Business-Approved Metric Repository, Modern Statistical Methodologies Minimizing Time-to-Insight, Easily Digestible Reporting, and more. Link.
Event of the week: Nudgestock 2023 — The topic is MESSY because everything and everyone is messy. Learn how to think like a behavioral scientist as counter-intuitive ideas and impact-driving case studies are discussed. Link.
Speero Story of the week: Users use the nav bar as an ad-hoc search to find products. If we add a search bar to the main navigation bar on mobile, will this bring more transactions and add to carts? Read below.
Blueprint of the Week: Cadence For Experimentation Meetings?
This is a clever little blueprint that suggests a ritual pairing of content and timing.
Weekly — The Test and Learn Ritual (Tactical Level)
What roadblocks and blockers have you got this week?
How to move past them and influence test velocity?
How to ensure everyone is on track?
Monthly — The Planning and Process Ritual (Audit of the planning, process, and the flywheel itself).
Do all parts of the flywheel work properly?
How can we address them?
Document issues?
Quarterly — The Assessment and Integration Ritual (The input and output sides of the process)
What are your OKR-style big initiatives and rocks?
What kind of research do you want to do?
Which big themes around customer problems or opportunities to address?
Quarterly — The Decision and Action Ritual (Here you consider the quality of decision-making)
Who is making the decisions and how?
In what priority?
How quickly are decisions being made?
Experimentation Meeting Cadence Blueprint is a nice combination of how and when you need to have touchpoints with your team, and which topics you need to cover.
Use Cases:
— Create systems of feedback with your team
— Influence the culture of your program or org
— Train and educate your team
— Build systems of accountability
Talk of the Week: 7 must-know CRO fundamentals based on running 22,000 tests with Ayat Shukairy
In this session on Experiment Nation, Ayat Shukairy shared 7 CRO fundamentals she learned from analyzing over 22,000 AB tests on 700 different CRO projects. The lessons contain ‘common patterns’ that helped her team deliver upward of 50% success rate on A/B Testing programs.
You’ll learn both what’s a strategic roadmap for a CRO project and the tactical details that help you run day-to-day activities.
Learn about:
— What it really takes to run a successful CRO program (Time, resource, management, etc).
— The right balance between strategy and tactics when running an experimentation program.
— Attendees will see an actual project management board running a CRO program
Read of the Week: The Modern Experimentation Workflow with Eppo + Snowflake
Most companies run experiments with manual workflows in ad-hoc Excel sheets or Jypiter notebooks. Manual workflows lead to a lack of trust and fragmentation, with teams defining metrics or statistical standards differently. This often leads to failed experimentation programs and wrong inferences.
There’s a better way. Since data warehouses are the most accurate and up-to-date metrics, it's vital that experimentation workflows run natively on top of them. This way you build a foundation of trust that’s vital in high-stakes environments where small metrics impacts of 2-5% can have a significant impact.
In this post, you’ll learn how Eppo built a Snowflake-native experimentation platform with the following key principles:
— Standard, Reusable Data Wrangling Logic from established Sources of Truth tables
— Business-Approved Metric Repository
— Democratized, Uncorrelated, and Reliable SDKs for assignment
— Automated Data Quality Monitoring
— Modern Statistical Methodologies Minimizing Time-to-Insight
— Easily Digestible Reporting
Event of the Week: Nudgestock 2023
Nudgestock. The world’s largest festival of creativity and behavioral sciences attracts anyone interested in understanding the human animal.
The 2023 topic is MESSY.
Because we’re messy.
Our heads are messy.
Our organs are messy.
The world is messy.
But where there's a mess, there's an opportunity to change behavior.
At Nudgestock, C-suite marketers, practitioners, and the nudge-curious will learn how to think like a behavioral scientist as counter-intuitive ideas and impact-driving case studies are discussed, debated, and celebrated by the planet’s boldest thinkers.
Happening on Friday 7th July 2023.
Old Truman Brewery, London.
Keynotes and panel sessions will run from 9-5 BST with a final hour to get messy in London’s most iconic brewery.
.svg)
