How To Balance Test Velocity vs Complexity?

Blueprint is probably one of Speero’s favorite frameworks to benchmark and understand the progress and state of our clients’ experimentation programs. This blueprint tells the story of two opposing forces—Better tests with more impact VS running more tests. This is a never ending battle. You can’t have the cake and eat it too. 

The key here is balance. You should be constantly moving toward the upper right side of the graph—run more tests.  But as you run more tests, you want to slowly build the capability to run more complex tests and to run the more efficiently every time you jump a certain ‘hurdle’ on this graph. This way, you’re building velocity AND complexity simultaneously.

- Monitor the health and progress of a testing program over time.
- Use as a conversation and alignment tool for a team, so that they have a way to measure progress.