Program Maintenance Metrics
The Program Metrics Blueprint lets you monitor the success of your experimentation program. Why is this important? Besides tracking revenue metrics like the number of wins or losses from the experiments, you should also look at program metrics to report back to on a monthly or quarterly basis.
If you're in a situation where you are in charge of running experiments on the site but are facing some slowdowns or issues in efficiency, you need to think about the relevant metrics that will help you identify the bottlenecks in your program.
For example, if the test velocity has been going down, you can identify where the problems lie by reviewing how many ideas are being submitted every month, or maybe even how many ideas are in the backlog. If idea generation is not the problem here, you should be tracking how long test creation is taking for the team by looking at time and sub-tasks.
Use Cases:
- Increase your testing velocity.
- Monitor the success of your experimentation program.
- Improve the efficiency and effectiveness of your program.
Apply this blueprint
If your experimentation program focuses on retention, use the Repeat Purchase & Post-Purchase Research recipe to investigate why customers do or do not buy again. Use this blueprint alongside that investigation to monitor how effectively the program operates.
For method-level guidance, read our Customer Survey reference.