EXL 2025

BY SPEERO AND EPPO

THE
experimentation event of the year

October
(20) 21-22
Austin, TX

We will tackle advanced topics and conversations like no other CRO/Experimentation conference out there.


This year, EXL will be the first conference to bring together the two sides of the coin: 'Growth + Platform'. Winning with experimentation requires growth-minded leadership and the platform experts to support them.

October
(20) 21-22 Austin, TX

GET TICKETS

Check out the vibe at EXL:

This year, our conference agenda is built around two core themes: Growth and Platform. Every talk, workshop, and speaker will align with one of these focus areas:

  • Growth: Content tailored for marketers, product managers, and metric owners driving business impact through experimentation.
  • Platform: content designed for ops, enablement, and data/tooling experts who build the infrastructure that makes experimentation possible.

Whether you're optimizing for growth or building the foundation that enables it, this conference is for you.

Principles that make This Event format extraordinary.

1.
Relationships over powerpoints.

We designed the event to ensure the people you should meet, you meet. We hand-curate discussion roundtables and facilitate connections.

You have very specific problems and goals. There are people who have the exact same goals, and have already figured it out. You should talk!

2.
Best possible practitioners teach their craft.

Learn from the absolute best in the field. All speakers are hand-picked practitioners. No motivational book-tour people. No sales pitches.

Speakers stick around for the full event, so you can pin them down for a 1:1 session.

3.
It feels like a big dinner party.

Fun is a serious business at EXL. All-you-can-eat and drink all day long. Music and entertainment.

No to stuffy conference rooms. This is an outdoor-first event. You’re leaving your home, it’s gotta be worth it. You’ll have fun, we promise.

Topics you want to discuss. Hand-curated table sessions

Half of the event is designed for meeting people. We hand-curate whom you should meet.

You have very specific problems and goals. There are people who have the exact same goals, and have already figured it out. You should talk!

EXL focuses on building authentic relationships and spending quality time with other like-minded people. Conferences can be great, but most people don’t go for the Powerpoint presentations.

And shared experiences unite people – making these relationships much stronger than a random encounter.

How we match you up with the right people?

We survey every attendee about what they’re working on, key goals, experience, and obstacles.

Based on what you tell us, we create many rounds of dedicated, moderated discussion table sessions, so people working on similar things get together and learn from each other.

This way you get to actually learn how something is done while becoming fast friends.

It’s not recorded.
won’t end up on YouTube.

You can pretend a lot of things, but you can’t pretend showing up. Events are not about the content. People forget what one or another speaker said. Most content is available on YouTube anyway, or might be better as a podcast.

What virtual events and online content can’t deliver is human relationships. Conferences are made for lasting professional relationships. That’s the whole point.

SPEAKERS

Talks based on our ‘Growth + Experimentation’ theme this year. And we drill down to get foundational operation and leadership perspectives as well.

GROWTH

ELENA
VERNA

Lovable

B2B Growth; elenaverna.com,
Growth stuff at Lovable.
Advisor at Superhuman

alexey komissarouk

Reforge

Growth Engineering | Ex-Masterclass, Ex-Opendoor

Makram Mansour

Intuit

Principal Product Manager - Emerging Products, #Experimentation
XOS  PLATFORM

Martin Tingley

Microsoft

Head of Experimentation, Windows at Microsoft

Elena
Grewal

Data 2 the People

Founder at Data 2 the People, Ex-Airbnb Data Science, Lecturer Yale, Ice Cream Shop Owner

Medha
Umarji

Fanatics

VP, Experimentation at Fanatics, Inc.

Diana Jerman

Disney |  Hulu  | ESPN

Director, Product - Experimentation
OPS  PLATFORM

JOHN CUTLER

DOTWORK

Head of Product
ex-Toast
LEADERSHIP

Thomas Fredell

TransformIQ.ai

Product Model Transformation Coach & Technologist | Ex-CTO/CPO with Multiple Unicorn Exits

Moderators (your core peer group)

Lee
Carson

Comcast
Remote Senior Director, Digital Experimentation

More to
be added

We aim for 50 moderators.

AGENDA

DAY 0  - Workshops
(Optional) MONDAY, OcT 20th

A day before the conference we host a special Workshop/Masterclass Day. We have a selection of expert workshops to choose from. Every attendee can choose 2 workshops to participate in, one set in the morning, and the second set in the afternoon.


AI Prototyping for Testing Teams, by Colin Matthews

A hands-on introduction to building functional AI prototypes without coding skills, designed specifically for experimenters and PMs looking to accelerate their workflow.

  • Introduction to AI prototyping tools: Overview of Bolt, V0, Replit, and Claude
  • Building your first prototype: Step-by-step guide to creating a simple functional MVP
  • Debugging common issues: Practical strategies for troubleshooting AI-generated code
  • UI replication techniques: Methods for quickly recreating existing interfaces
  • Integration basics: Connecting your prototypes to popular tools like Slack and Google Sheets

AI Analysis for Customer Research, by Caitlin Sullivan

A hands-on crash course in using AI to extract insights from messy customer feedback—designed for marketers, PMs, and growth leads who want to understand customers faster, and find what really moves the needle.

Based on the highly rated Maven course featured in Product, Design and AI categories.

  • Structured workflows: Step-by-step methods that uncover insights even humans miss.
  • Data prep that actually works: Clean & format messy feedback so AI can analyze.
  • How to run smarter tool tests: A battle-tested protocol to compare 5 AI tools in a day.
  • You might be causing your AI’s hallucinations: Fix prompting mistakes that break results.
  • Comparing LLMs vs. research-specific AI tools: What’s best for your team
  • Human + AI collab: Know which parts of analysis to automate—and which ones to own.

DAY 1

Tuesday, OCT 21th

10:00

Ben Labay & Ryan Lucht – Opening

10:20

Thomas Fredell - The Leadership Platform: Powering Breakout Growth

What drives breakout business growth? Leadership that empowers teams and fosters innovation. In this dynamic keynote, Thomas Fredell, a seasoned founder and CTO/CPO with multiple exits and an IPO, shares how empowered, outcome-focused product teams, inspired by Marty Cagan’s Product Operating Model, outperform rigid top-down plans. Drawing from his experience building the first virtual data room for M&A, Thomas shows how leaders can shift from directing to enabling—coaching teams, setting clear vision, and creating psychological safety for rapid experimentation. Through examples of remote-first teams and continuous testing, he reveals how experimentation fuels learning, iteration, and better business outcomes. Expect practical insights to transform your leadership and unlock team-driven growth.

11:00

John Cutler - Your (Experimentation) Operating System as a Design Problem

How do you scale effective local team behaviors across an organization? This talk addresses this challenge, focusing on moving beyond top-down mandates for product operating models and experimentation cultures. The key is designing a thoughtful operating system to make change stick. We’ll explore rituals and language, drawing from service, game, learning, and human factors design. Operations should shape how people work, learn, and adapt, not just focus on process efficiency.

11:30

Moderated Table session #1

A special table session where folks are grouped by biz size, vertical, and roles to discuss implications of leadership and operations on their org’s growth.

12:30

Lunch & Networking

1:30

Moderated Table session #2

Topic specific to each table.
You will be in hand-curated groups by interests, experience, etc.

2:30

Break

3:00

Medha Umarji - From Scrappy to Scalable - Evolving Experimentation at Fanatics

This talk will focus on the challenge of evolving a basic A/B testing program into a fully scaled, self-sustaining experimentation ecosystem. We’ll dive into both strategic and operational components - managing an in-house testing tool, balancing roadmap bandwidth across teams, creating a flywheel of ideas that keeps experiments flowing, and designing a scalable data pipeline.

3:20

Diana Jerman - Lessons Learned from Scaling Experimentation at Disney+ & Hulu

A common question in scaling experimentation programs is "How do we develop high-velocity experimentation?" Through my experience leveraging and enabling experimentation, and through countless hours collaborating with teams across Disney, external industry peers, and thought leaders, I have identified three key areas for improving any experimentation program: (1) strengthening of the experimentation culture, (2) enhancing automation and tooling capabilities, and (3) implementing robust measurement frameworks.

Understanding the difference between teams with a high velocity of testing vs low is an effective way to identify challenges and develop actionable approaches for how we help teams improve their experimentation speed and efficiency.

3:45

Break

4:00

Moderated Table session #3

Topic specific to each table.
You will be in hand-curated groups by interests, experience, etc.

5:00

Break & Games

6:00

DINNER, GAMES, DRINKS AND CONNECTIONS UNTIL MIDNIGHT

Pure, unscripted fun. This is where the magic happens.

DAY 2

Wednesday, OCT 22nd

9:00

Coffee and Breakfast

10:00

Martin Tingley - Self-improving products: Experimentation + Gen AI

What if your digital product could learn and improve itself—automatically? In this talk, I introduce a five-level framework to understand an organization’s learning and product development capacity, from basic build-and-ship to fully self-improving systems. Each level on the ladder represents a step-change in how we generate, test, act on, and learn from ideas, and requires changes to both experimentation tooling and practice. This framework can help you identify where your team is today—and what it takes to climb to the next rung.

10:20

Elena Grewal - The story of Data Science at Airbnb

This talk will share the story of how Airbnb created a rigorous experimentation culture focused on the voice of the customer and was able to drive significant business impact as a result. Dr. Grewal was at the front lines of the rocketship growth of Airbnb’s business, joining as one of the first data scientists in 2012, and departing 7 years later as the Head of Data Science leading a team of 200 data scientists.  She will share her perspective on the key factors that led to a close link between experimentation and growth at Airbnb and how data science contributed to this. Find out what the very first experiment was that was run at Airbnb and the major changes at the company that came from the results. Then learn about the steps that leaders and data scientists took to spread experimentation to all departments and, critically, to invest in a rigorous experimentation platform that enabled that spread.

10:40

Break

11:00

Moderated Table session #4

Topic specific to each table.
You will be in hand-curated groups by interests, experience, etc.

12:00

Lunch & Networking

1:00

Moderated Table session #5

Topic specific to each table.
You will be in hand-curated groups by interests, experience, etc.

2:00

Break

2:20

Elena Verna - Growth in the Age of AI

Building inside an AI company is like scaling a product that’s still being invented - by users, models, and some chaos. Growth isn’t about playbooks anymore; it’s about keeping up with a product that evolves daily and customers who expect magic. I’ll share what it’s really like to run growth in an AI-native world.

2:40

Alexey Komissarouk - Building an AI-first Growth Organization

Your engineers are already vibe-coding their experiments, so why stop there?  In this talk, we'll talk through the AIificiation of Growth, exploring a Growth organization moving at breakneck pace, decoupled from human bottlenecks.

3:00

Break

3:20

Mansour, Makram (Intuit) - Testing Business Ideas: Journey from Ideas to a Viable Business

Enterprise teams excel at optimizing existing products through experimentation. But what happens when the goal shifts from optimization to launching entirely new lines of business?

Makram built the testing programs at Linkedin and Intuit, here he’ll speak to his new role in ‘emerging products’ and reveal how leading companies structure for sustained growth—connecting core product teams, the CTO office, M&A, and internal ventures. We’ll unpack how these groups rigorously test new business ideas using a “three fits” framework: on paper, in the market, and in the bank. You'll learn how a Shark Tank-style process and succession metrics guide ideas from concept to validation, and how AI accelerates this path by focusing resources on what’s truly viable.

You’ll leave with a practical blueprint for building a repeatable, data-driven pipeline for new business growth within your enterprise.

3:40

Closing Remarks

6:30

After Party:  Networking & Games

Pure, unscripted fun. This is where the magic happens.

Did we say parties?

Have fun and make friends. Everybody there will be in the same boat as you, so lots to talk about. A 30-minute conversation at an event will already make a life-long connection.

Pre-party on
October 20th.

The main party is on October 21th.

Location

Central
Machine
Works

4824 E Cesar
Chavez St,
Austin, TX
78702

Workshop Day
(Optional)

A day before the conference (October 9th) we host a special Masterclass Day. Every attendee can choose to attend 2 workshops, one set in the morning, and the second set in the afternoon.

Workshops are a good match for you if you're really serious about skill building - they're much longer and go more in-depth than individual sessions at the conference.

Workshop 1: Ronny Kohavi – Advanced topics in Practical A/B Testing

The course covers topics not usually covered in introductory courses, including Ronny's Maven class on A/B Testing and his book. These advanced topics include:

- P-values misconceptions,
- Power, and False Positive Risk
- Why you should always give positive results a haircut 
- Success rate estimation, and success of ideas vs. experiments
- The cost of false positives
- TOST and early stopping – when and how to correctly peek
- Bayesian and Frequentist approaches
- CUPED – variance reduction
- Risks of unequal variants and rare events
- Long-term holdouts
- Simpson’s paradox
- Randomization strategies: front door or at trigger point, ramp-up
- Cultural issues: can I test that?  OFAT or major redesigns

When you register for the conference, you will get a $500 off coupon code for Ronny's Maven class: Accelerating Innovation with A/B Testing (https://bit.ly/MavenABClassEXL), which you can take before this workshop.

Workshop 2: Applications of AI in experimentation

This afternoon workshop will feature 10-15 minute presentations from various practitioners on their applications of AI within the practice and flywheels of AB testing, customer research, and experimentation.

Exact presenters and topics TBA, stay tuned.

We do know that the OG himself Craig Sullivan will MC the AI workshop session along with Iqbal Ali.

They've been working on AI 'playbooks' for experimentation and will lead some hands on sessions on these topics.

- discovery,
- problem exploration,
- problem statement,
- solution statement,
- ideation,
- hypothesis,
- hyp/problem checker

Additionally Andy McNaught from Onxmaps.com has been doing some fantasic applications of LLM models and testing, he'll be attending as part of this showcase.  

Duration: 8 hrs (9am to 5pm).
Lunch included
Added cost: $500

Conference AGENDA

DAY 0

WEDNESDAY, OCT 9th  (OPTIONAL)

9:00 am - 12:00 pm

Advanced topics in Practical A/B Testing Workshop 1: Ronny Kohavi

The course covers topics not usually covered in introductory courses, including Ronny's Maven class on A/B Testing and his book. These advanced topics include:
- P-values misconceptions,
- Power, and False Positive Risk
- Why you should always give positive results a haircut
- Success rate estimation, and success of ideas vs. experiments
- The cost of false positives
- TOST and early stopping – when and how to correctly peek
- Bayesian and Frequentist approaches
- CUPED – variance reduction
- Risks of unequal variants and rare events
- Long-term holdouts
- Simpson’s paradox
- Randomization strategies: front door or at trigger point, ramp-up
- Cultural issues: can I test that? OFAT or major redesigns

1:00 pm - 5:00pm

Experimentation Workshop 2: Various, MC'd by Craig Sullivan

This afternoon workshop will feature various short presentations from practitioners on their applications of AI within the practice and flywheels of AB testing, customer research, and experimentation.

Exact presenters and topics TBA, stay tuned.

We do know that the OG himself Craig Sullivan will MC the AI workshop session along with Iqbal Ali.

They've been working on AI 'playbooks' for experimentation and will lead some hands on sessions on these topics.
- discovery,
- problem exploration,
- problem statement,
- solution statement,
- ideation,- hypothesis,
- hyp/problem checker

Additionally Andy McNaught from Onxmaps.com has been doing some fantasic applications of LLM models and testing, he'll be attending as part of this showcase.

5:00pm

Conference pre-party at Zilker Brewing Company and Taproom

Address: 1701 E 6th St, Austin, TX 78702

DAY 1

THURSDAY, OCT 10th

10 am

Ben Labay & Collin Crowell: Opening

10:20 am

Melissa Weiss: When experimentation isn’t love at first test

We are a group of passionate practitioners energized by experimentation but not every individual, team, or organization will embrace the craft as we have. Resistance arises when one’s product development ideals conflict with misconceptions or misapplications of experimentation. Changing perceptions is crucial to fostering a successful practice. I’ll share examples of navigating reluctance at the team and org level.

10:40 am

Carole Robin “Connect” Workshop: Grow Impact by Building Stronger, More Robust Relationships

The premise of this session is that people do business with people -- not products, strategies, or money -- and interpersonal competence is a proven determinant of professional success. In this interactive experiential workshop (talk then table session), participants will increase their interpersonal competence and learn how to more effectively influence and lead.

11:30 am

‘Connect’ Moderated table session #1

Topic: Connect session
A special moderated table session that extends Carole Robin’s content to allow hands on application of principles. Small groups will perform some ‘connect’ exercises, prompts coming from Carole.

12:30 pm

‘Connect’ Q&A with Carole

1:00 pm

Lunch and Networking

2:00 pm

Moderated table session #2

Topic specific to each table
You will be hand-curated into groups by interests, experience, etc. Topics and prompts will vary.

3:00 pm

Break

3:20 pm

Lukas Vermeer: Bridging the gap: Integrating the Product Operating Model and the Experimentation Growth Model

In 'Bridging the Gap,' we compare the Product Operating Model (POM) and the Experimentation Growth Model (EGM), revealing their shared focus on customer-centricity, iterative development, and data-driven decision-making. Join us as we explore how integrating these models can drive sustainable success in today's digital landscape.

3:40 pm

Stewart Ehoff: The Golden Thread - Connecting research, experimentation & business ROI

Speak to a researcher in any large organization and ask them their top frustration. Most will tell you it's action and impact as a result of the work they do. This problem goes far wider and deeper than just individual researchers getting their work stuffed into a drawer, it's a systemic problem with the way companies decide to solve problems, and validate that they've been solved. Join me in this talk to explore my thoughts on how to solve this big hairy business problem, by making research actionable, connected to your experimentation program, and most importantly, to the $$$ outcomes it drives.

4:00 pm

Moderated table session #3

Topic specific to each table
You will be hand-curated into groups by interests, experience, etc. Topics and prompts will vary.

5:00 pm

Break + Games

6:00 pm

DINNER, GAMES, DRINKS AND CONNECTIONS UNTIL MIDNIGHT

Pure, unscripted fun. This is where the magic happens.

DAY 2

FRIDAY, OCT 11th

10:00 am

Chad Sanderson: Federated data management

Chad will tackle why you need modern data management in the age of hyper iteration, experimentation, and AI. Explore why traditional data management practices fail and how the cloud has fundamentally changed data development. Learn about the modern application of data management best practices, including data change detection, data contracts, observability, and CI/CD tests, and outline the roles of data producers and consumers. Get a clear understanding of modern data management's components and how to leverage them for better data handling and decision-making.

10:20 am

Luke Mortensen: Experimentation 2.0: Navigating the Next Wave of CX Innovation

Join Luke as he explores a broader definition of experimentation, focusing on upcoming avenues of product and CX innovation. Traditionally, most CX experimentation has centered on creative, design, copy, format, and product flow testing. With Gen-AI tools making these variations less expensive to release, we'll delve into new experimentation methods like model-variation testing and explore/exploit optimization. Discover less common experimentation types today that will become key to performance improvement in the near future.

10:40 am

Break

11:00 am

Moderated table session #4

Topic: What's working for you right now?
People are grouped to tables of 8-10 by company size and role. You will learn how your peers from similar-sized companies are driving results.

12:00 am

Lunch and networking

1:00 pm

Moderated table session #5

Topic specific to each table
You will be hand-curated into groups by interests, experience, etc. Topics and prompts will vary.

2:30 pm

Break

3:00 pm

Shanelle Mullin: Learning from experimentation - How to build knowledge and extract insights

We experiment to measure, reduce risk, optimize, forecast, and most importantly—to learn. When a single experiment wins, we know what worked for one audience on one page at one point in time. But the real value of experimentation comes from learning at scale. With the right analysis, your experimentation program can become greater than the sum of its parts.

3:20 pm

PHIL BURROWS: When moving fast becomes too slow: Operating frameworks for iteration, impact & scale

As talent continues to get sharper & technology becomes more advanced, it’s become a testing, optimization & AI/ML arms race over the last 2 to 3 years in an effort to reach consumers on a 1-1 level. While this new standard being set by consumers & companies continuously reaching to set a new bar has limitless opportunity, the process as well as organizational strain & bi-product of  these new models make it extremely difficult for organizations to adopt at scale. This interactive discussion will help you identify where challenges exist within your company's ecosystems as well as organizational strategies & frameworks that enable long term sustainable scale.

4:00 pm

Closing

6:00 pm

After party, location TBD

Did we say 2 parties?

Have fun and make friends. Everybody there will be in the same boat as you, so lots to talk about. A 30-minute conversation at an event can make a life-long connection.

Pre-party on October 9th.The main party is on October 10th. On 11th we'll have an unofficial party someplace somehow...

Location

Central
Machine
Works

4824 E Cesar
Chavez St,
Austin, TX 78702

TICKET PRICING

Individual tickets

Team ticket (3+ tickets)

Vendor,
Agency, or Consultant Ticket

You work for an agency, tool vendor, consultants, etc.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

$2400 (USD)

BUY

Discounted inhouse ticket

You work for a brand, growing a product and program of experimentation.

Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.

$900 (USD)

BUY

TEAM Discount
on both
ticket types:

Bring 3+
people and get
20% off.

Build the best tech stack for experimentation and personalization

Want to sponsor? Reach out to ben@speero.com for a sponsor prospectus and more information.

Build the best tech stack for experimentation and personalization

Sponsors

Want to sponsor? reach out to ben@speero.com for a sponsor prospectus and more information

Brought to you by