Experimentation / CRO

Experimentation and Testing Programs acknowledge that the future is uncertain. These programs focus on getting better data to product and marketing teams to make better decisions.

Research & Strategy

We believe that research is an integral part of experimentation. Our research projects aim to identify optimization opportunities by uncovering what really matters to your website users and customers.

Data and Analytics

90% of the analytics setups we’ve seen are critically flawed. Our data analytics audit services give you the confidence to make better decisions with data you can trust.

How Speero Scaled Cisco’s Experimentation Program With Speero’s Maturity Audit

Cisco, a worldwide brand with 71,000 employees, wanted to scale its global experimentation efforts. When you’re that huge, thinking about where to start is like searching for a needle in a haystack.

That’s when they partnered with Speero to help scale their global program and build internal alignment for it across all departments.

The Challenge

Sandip Amlani knows his way around global optimization. Behind a friendly smile is a guy with a two-decade track record of building high-traffic, multi-lingual websites for companies of all sizes, from start-ups to FTSE 100 organizations. In January 2017, he starts working as a Regional Digital Lead for the EMEAR region of Cisco. False starts and other delays slow down the start of their optimization.

Jum to summer 2018 — Sandip launches the first Centre of Excellence (CoE) for Cisco in the EMEAR region. Their fortunes change, as they jump from 3 to running 38 experiments in just 9 months. The executives are so pleased with CoE capabilities, they send an internal directive: “Improve how Cisco does optimization worldwide”.

...there was a drive to improve how we did experimentation globally across Cisco. I led the “People” track of this project and set about discovering how optimization was done in other regions, identifying gaps, and proposing a structure that allowed us to scale our testing efforts.

Sandip Amlani

Here’s the kicker: Cisco is a $51 billion company with 71,000 employees across 96 locations worldwide. To say that establishing experimentation across a complex enterprise such as Cisco would be a challenge is a really optimistic opinion:

  1. People naturally don’t like change or risk, especially in large companies. Risk takers are all outside the big organizations, starting and running their own businesses.
  2. The coordination and alignment issues are scaled proportionally to the number of people and teams. 
  3. People are paid for their opinions. Lawyers need to get paid too. So when you have so many people, the opinions and 'need to be considered' gets in the way of actually shipping.

“With our new global directive for optimization, we set out our goals:
1) Double the number of tests we ran per year
2) Establish an experimentation process.”

Sandip Amlani

Sandip ran internal workshops with different global and regional teams to build consensus on using a global, federated CoE structure. Then they all workshopped some more to identify all the areas, skills, and expertise they’ll need to set up to run a CoE.

“I created presentation decks to help set the scene for what this could look like—who the players were, what they might be doing at a high level, and what the ideal CRO process could look like.”

Sandip Amlani

Now Cisco team knew where they wanted to go with global optimization. But this wasn’t enough. They also needed a sharp, precise method to determine their current capabilities and experimentation maturity. Not to mention an effective roadmap for reaching their optimization goals cheaply and quickly.

This is where Speero comes onto the stage.

The Solution

Sandip brought Speero to access Cisco’s maturity with our Experimentation Maturity Audit. The audit helps us uncover all the rakes in the grass, bottlenecks, and ted tape you can experience during scaling.

Speero interviewed stakeholders across multiple departments for a precise assessment. Then we collated that data from interviews in order to:

  • Benchmark the current experimentation capabilities at Cisco.
  • Compare individual scores we then used to identify stakeholders’ ‘battlegrounds’.
  • Discuss these ‘battlegrounds’ to build shared understanding, consensus, and alignment.
  • Identify gaps, rakes in the grass, and weaknesses across all four maturity pillars.
  • Set up priorities and planned activities.

Ultimately, we built a scaling roadmap for Cisco that will let them focus on the areas with the most impact on their global optimization.

The Results

  • Combined research and experimentation program expertise to accurately assess the experimentation program at Cisco. 
  • Identified critical drivers for addressing gaps and weaknesses.
  • Provided the roadmap for Cisco to implement a global CoE, meeting the internal directive. (The Result)

“I’m incredibly excited and proud of where we are as a team and am looking forward to where we can take experimentation—and the impact it will have for our users and customers.”

Sandip Amlani

Key Takeaways


Evaluate your current experimentation maturity level.

Evaluate your business and its approach to experimentation to understand what you need to do to increase maturity. Access the maturity audit.


Understand what your audit results mean.

Give context to your audit results by reviewing our latest benchmark data to see how your organization compares.


Gain alignment across teams and stakeholders.

Use a RASCI Matrix to establish who's responsible, accountable, supporting, consulted, and informed across experimentation activities.

Let’s kick things off.
Tell us what you’re looking for

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.