Experimentation / CRO

Experimentation and Testing Programs acknowledge that the future is uncertain. These programs focus on getting better data to product and marketing teams to make better decisions.

Research & Strategy

We believe that research is an integral part of experimentation. Our research projects aim to identify optimization opportunities by uncovering what really matters to your website users and customers.

Data and Analytics

90% of the analytics setups we’ve seen are critically flawed. Our data analytics audit services give you the confidence to make better decisions with data you can trust.

Personalization opportunity

They paid. Then they never started setup.

Give them one first step. Not a tour of everything.

Intervention
Activation
SaaS, Media & subscriptions

Step 1 · Signals

What do we know about this person?

Connected

Purchase or signup timestamp with zero setup events.

Example eligibility rule

Trigger when a paid account or qualified signup has recorded no setup event within 24 hours and no teammate or implementation partner is actively completing setup. Exclude refunded, cancelled, fraudulent, and sales-assisted accounts with a scheduled onboarding session.

Step 2 · The need

What’s really going on?

The receipt went out. Login happened, or didn't. Setup step 1 is untouched. Welcome email #1 is a product tour of everything, which is the opposite of a first step.

Avoid this assumption

Onboarding is not a tour. It is getting this person to their first useful outcome.

Step 3 · Worth it?

Do the math before you build.

One specific first action is more useful than a generic "welcome to the platform" when the account has not started setup.

Reach

How many eligible people can you reach in the chosen channel and time period?

Cost

What will content, delivery, QA and ongoing maintenance cost?

Return

What incremental outcome would cover that cost, and what is it worth?

Planning inputs, not measured results. Estimate reach × incremental outcome rate × value per outcome, then subtract cost. Use a range and a consistent time period.

Step 4 · The response

Pick how you help.

Example format: Sequence

In-product checklist of one to three steps, based on plan or quiz.

Compare lighter and deeper responses

Choose the lightest response that solves the need.

Assist: Offer useful help

Leave the product alone. One email naming the single first step.

Adapt: Change a meaningful part

In-product checklist of one to three steps, based on plan or quiz.

Transform: Tailor the journey

A guided first-use flow that starts on the job they bought for, with a skip.

What to watch out for

  • Five emails before they have opened the product.
  • A tour that covers features they will not use for months.
  • No distinction between "hasn't logged in" and "logged in and froze".

Step 5 · The moment

Did it help? A/B test it.

Control

Default welcome and empty state.

Treatment

First-step-specific empty state and message.

Success measure

Setup started within 7 days, then first-value event.

Guardrail

Unsubscribes and repeated attempts to skip the tour.

Win or lose, record what worked, for whom and why. What you learn becomes the next signal.

Tools that can deliver the response

  • Appcues In-product engagement platform for building targeted flows, tooltips, checklists, and announcements without engineering.
  • Pendo in-app guides Product experience platform combining usage analytics with in-app guides targeted by user or account segments.
  • Customer.io Event-triggered lifecycle messaging across email, push, SMS, and in-app, built on a customer profile and behavior-data layer.
  • Braze Cross-channel messaging platform (push, email, SMS, in-app, WhatsApp, and more) that orchestrates sends off real-time customer behavior.

Try the framework on another situation

They started setup, then disappeared mid-step. Remind them of the unfinished step. Then stop.

The same setup step keeps failing. Give them another way through. Another tooltip won't fix it.

The trial is ending. They never really used it. Get them to actually try it before the clock runs out.

Work through it in the hub

Score your personalization program, explore more customer situations, and compare the tools that can deliver them.