Experimentation / CRO

Experimentation and Testing Programs acknowledge that the future is uncertain. These programs focus on getting better data to product and marketing teams to make better decisions.

Research & Strategy

We believe that research is an integral part of experimentation. Our research projects aim to identify optimization opportunities by uncovering what really matters to your website users and customers.

Data and Analytics

90% of the analytics setups we’ve seen are critically flawed. Our data analytics audit services give you the confidence to make better decisions with data you can trust.

Research method

Analytics Data Analysis

Analysis of website analytics data to determine overall performance, performance by segment, e.g. device, channel, user type, analysis of on-site behaviour or digging into the impact a specific element or piece of functionality has on performance and user experience.

When to reach for it

Understand overall on-site user behaviour with high levels of certainty (assuming no sampling) and the differences across key segments.

Dig deeper into the performance and / or impact of a specific page, element, or area of the website.

Strengths and limits

Pros

Analytics data is one of the most robust sources of data you can use to help you understand on-site engagement, interaction, and user behaviour. This is because this data is based on real user behaviour, without research bias, at a large scale.

Cons

Sampling issues can reduce the accuracy of your data, which can result in drawing false assumptions, making decisions based on flawed data, etc.

Analytics data will tell you what is happening on your site, but not why. As with session recordings and heatmaps, the data is also open to interpretation.

Robust analytics data analysis is a skill. It can easily be misunderstood or misinterpreted.

Practical considerations

Configuration

Effective analytics data analysis is reliant on a robust tool configuration, ensuring the data you're looking at is accurate. Effective set up can be complex and requires in-depth tool knowledge, ideally from a developer or from someone with experience in setting up analytics tools.

Analysis

As analytics data is open to interpretation it is important to keep analysis actionable. At times it is relevant to simply point out facts, e.g. x% of data comes from mobile devices. But from an optimisation perspective, we should be considering the "so what?", e.g. what does this tell us, what opportunities does this present, etc?

Tools

There are many digital analytics tools available. Chances are the business you work in or with will already use one. Google Analytics (now GA4) is one of the most popular and most well-known tools. The transition from Universal Analytics to GA4 happened in 2023 which significantly changed the way GA works.

Common tools

Go deeper

Recipes that use this method

A method earns its value when its signal corroborates others. Here is where this one does its work.

Last updated

July 20, 2026