
Author: Martin P.
Title: Content Marketer
EP16: Iterate Vs Move On Framework
One test is all you need to start the experimental revolution.
Welcome to Speero’s newsletter: The Experimental Revolution.
Where we discuss all things related to CRO, CXO, and experimentation in business.
Your host is Martin P.
Here is This Week in Experimentation:
Iterate vs Move On Blueprint: A starting point for experiments prioritization. But its real power comes from combining it with your unique business needs and prioritization frameworks. Link.
Listen to Ben Labay and Aaron Wroblewski talk about how to develop a healthy tool stack and robust blueprints, the foundation of fast and effective experimentation programs. Link to the video.
A roundup of (14+4) best CRO/CXO/Experimentation posters on LinkedIn. Only include those who post regularly and don’t push gated content. Link.
A meta-analysis of 1,001 A/B tests. From the test length to average lifts achieved, explore how top conversion rate optimization specialists come up with impactful interventions. Link.
Get to know the two easiest and quick-start ways of building reports in GA4 and how to use the new customizations they offer over the traditional UA methods of reporting. Link.
Increase your eCommerce conversion rate with data-driven validation using A/B-testing. Lucia from Speero and Josh from Adore Beauty will let you take a look behind the scenes at their high-velocity testing program. Link for registration.
Blueprint of the Week: Iterate vs Move On Blueprint
This blueprint lets visualize how you prioritize your experiments.
You can include it in your program as a standalone feature, but its real power comes from combining the logic behind this blueprint with your own prioritization frameworks and unique business needs.
The blueprint is also an intuitive visualization of how many iterations are vital to experimentation. However, feel free to de-prioritize this blueprint if other initiatives take precedence.
Take this blueprint as a starting point for your decision-making, not as a must-use.
Link.
Talk of the Week:
Running modern experiments requires a healthy tool stack and robust blueprints.
On this episode of Testing Insights, we chatted with Aaron Wroblewski, the Senior Manager of Machine Learning at Zillow—a company that makes over two billion experimentation decisions per day.
To get to the heart of the tools Zillow uses and why Speero’s Ben Labay asked Aaron three key questions:
1. What do you think of the “traditional” program tooling framework?
2. How can third-party tools enhance your flywheel?
3. what are the tradeoffs to a hybrid approach vs. a single platform?
Reads of the Week:
A roundup of (14+4) best CRO/CXO/Experimentation posters on LinkedIn. Link.
Convert(com) has made a list of the best posters in our industry. But they go for influencers living on old glory. On the contrary, they found people who regularly post, don’t gate content, and focus on experimentation.
What Can Be Learned From 1,001 A/B Tests? Link.
Georgi Georgiev talks about what they learned from a meta-analysis of 1,001 A/B tests. How long does a typical A/B test run? What percentage of A/B tests result in a ‘winner’? What is the average lift achieved in online controlled experiments? How good are top conversion rate optimization specialists at coming up with impactful interventions for websites and mobile apps?
Data Analysis and reporting in GA4 for eCommerce. Link.
Building reports and analyzing data in GA4 is as simple as working with a drag-and-drop tool. In this article, you will get to know the two easiest and quick-start ways of building reports in GA4 and how to use the new customizations they offer over the traditional UA methods of reporting.
We have seen big friction in the acceptance of GA4 simply because the flat tables and trend line reports we had in UA don't exist in the standard part of reporting (maybe in the future). For many UA users, this new system of consolidated reporting and new method of processing data does not make sense.
Event of the Week: Lift your eCom Conversion Rate Workshop
Increase your eCommerce conversion rate with data-driven validation using A/B-testing.
Join Lucia van den Brink (Senior Strategist at Speero) and Josh Rowe (Australia-based CRO expert and ex-Head of Product at Adore Beauty) who will share big wins, and tools and processes to get the results.
Learn:
- How data-driven A/B testing can increase your eCommerce conversion rate.
- The importance of testing velocity - do you know how many tests you can run?
- How to start experimenting strategically - Goal tree map, CX research, ideation, and prioritizing A/B tests for impact and other tools and processes.
3rd November 2022. (4 pm AEST)
No registration fee.