Experimentation / CRO

Experimentation and Testing Programs acknowledge that the future is uncertain. These programs focus on getting better data to product and marketing teams to make better decisions.

Research & Strategy

We believe that research is an integral part of experimentation. Our research projects aim to identify optimization opportunities by uncovering what really matters to your website users and customers.

Data and Analytics

90% of the analytics setups we’ve seen are critically flawed. Our data analytics audit services give you the confidence to make better decisions with data you can trust.

Research recipe · Foundational

Researching With Low Traffic

Foundational
Explore
Hypothesised
We can't test because traffic is too low

The problem, in the customer's voice

We can't test because traffic is too low
We don't have the volume to be statistically significant, so every change is a leap of faith.
How might we build evidence for decisions when traffic can't support A/B tests?

What this recipe does

When traffic is too low for a suitably powered A/B test, recruited-participant research can identify usability problems, test message comprehension and explore stated preferences. It cannot establish how much a change will increase conversion or revenue on your live site.

Start with a UX heuristic review and competitor review to generate questions, not proven fixes. Recruit people who fit the intended audience for remote usability studies and copy testing. Observe where they struggle with tasks and what they understand; distinguish observed behaviour from what participants say they would do.

At the Validate step, preference tests compare stated choices and the reasons behind them. Prototype testing checks whether participants can understand and use a proposed design in the study setting. Use these findings to revise a design, reject a weak concept or decide whether a limited, reversible rollout is justified. Neither method substitutes for a randomized experiment measuring live business outcomes.

Record the remaining uncertainty, participant selection and study conditions. If you ship without an adequately powered experiment, monitor guardrails and define rollback criteria, but do not label a before-and-after change as causal conversion lift. Revisit controlled measurement when it becomes feasible.

Explore. Focus. Validate.

Explore

Use expert and competitor reviews to generate research questions. These are hypotheses, not evidence that a change will improve conversion.

Focus

Recruit relevant participants. Remote usability studies reveal observed task difficulties; copy testing examines comprehension and reported reactions. Findings depend on the sample and study setting.

Validate

Validate the proposed experience, not a conversion-lift claim. Preference tests measure stated preference; prototype tests examine usability in study tasks. Use the results to revise or reject a concept and document what remains unknown. Neither replaces a randomized A/B test of live outcomes.

The methods in this recipe

Last updated
October 15, 2026

Want this run for you?

Speero scopes, runs and synthesises this recipe as part of research and experimentation engagements.