Experimentation / CRO

Experimentation and Testing Programs acknowledge that the future is uncertain. These programs focus on getting better data to product and marketing teams to make better decisions.

Research & Strategy

We believe that research is an integral part of experimentation. Our research projects aim to identify optimization opportunities by uncovering what really matters to your website users and customers.

Data and Analytics

90% of the analytics setups we’ve seen are critically flawed. Our data analytics audit services give you the confidence to make better decisions with data you can trust.

Personalization opportunity

They're ready to buy something new. You keep selling last time.

Let this visit lead. Don't trap them in what they already bought.

Direction
Conversion
E-commerce

Step 1 · Signals

What do we know about this person?

Connected

Purchase history plus repeated comparison or cart activity in a different category.

Example eligibility rule

Require at least two completed purchases in the historical category, then at least two PDP views and one cart add in a different category during the current session. A single view in a new category is not enough to change the experience.

Step 2 · The need

What’s really going on?

A known customer has compared products in a new category and added one to the cart. The cart and recommendations still push the last purchase instead of helping complete the new decision.

Avoid this assumption

More recommendations is not more personalization. This case improves the current purchase decision. "A regular is looking for something new. You send them last year's path." redesigns the broader returning-customer experience.

Step 3 · Worth it?

Do the math before you build.

The session is telling you the job changed. Using history as a prior, not a prison, is where specificity pays.

Reach

How many eligible people can you reach in the chosen channel and time period?

Cost

What will content, delivery, QA and ongoing maintenance cost?

Return

What incremental outcome would cover that cost, and what is it worth?

Planning inputs, not measured results. Estimate reach × incremental outcome rate × value per outcome, then subtract cost. Use a range and a consistent time period.

Step 4 · The response

Pick how you help.

Example format: Recommendations

Session-first recs, with a small "your usual" module.

Compare lighter and deeper responses

Choose the lightest response that solves the need.

Assist: Offer useful help

Keep recs, but label them "from last time" and demote them below session matches.

Adapt: Change a meaningful part

Session-first recs, with a small "your usual" module.

Transform: Tailor the journey

A split merchandising layout: "for this visit" vs "your staples", and a path to switch.

What to watch out for

  • Wiping history the moment someone browses a gift.
  • No language that explains the shift, so it feels random.
  • Applying the same rule to first-time buyers with thin history.

Step 5 · The moment

Did it help? A/B test it.

Control

History-weighted recs and homepage.

Treatment

Session-need weighted recs for known buyers.

Success measure

Completed purchase in the new category.

Guardrail

Repeat-purchase rate of staples. Do not bury a familiar path that still matters.

Among known buyers who meet the category-shift rule, compare session-first recommendations with history-first recommendations. Report new-category purchase and staple repurchase separately.

Win or lose, record what worked, for whom and why. What you learn becomes the next signal.

Tools that can deliver the response

  • Bloomreach Ecommerce Search AI-driven ecommerce search and discovery platform (Loomi AI) that personalizes ranking, recommendations, and merchandising from first-party shopper data.
  • Dynamic Yield Personalization and recommendations platform with a merchandising engine and Experience APIs for running recs and server-side experiments on any channel.
  • Monetate Retail-focused "Experience Optimization Platform" combining AI-driven personalization/recommendations, merchandising, and no-code/server-side A/B testing under one engine (MONET), backed by a managed-services "Concierge" team.
  • Adobe Target Uses machine learning (a Random Forest model plus a multi-armed bandit) to automatically select the best-performing, marketer-defined experience for each visitor, rebuilding its model roughly every 24 hours.
  • LimeSpot On-site recommendations plus adaptive headlines, banners, and collections for Shopify, BigCommerce, and SHOPLINE stores.
  • Rebuy Shopify-native merchandising widgets and bundles across every storefront page, cart through post-purchase.
  • Algonomy Retail personalization suite (search, recs, dynamic listing pages, content/styling, social proof, shopping agent) built on the earlier RichRelevance/Manthan merger. Now operating under the ADA brand after ADA acquired Algonomy in July 2026.

Try the framework on another situation

Work through it in the hub

Score your personalization program, explore more customer situations, and compare the tools that can deliver them.