From Weeks to Minutes: How Prompt-Based Experimentation Changes Everything
Failed to add items
Add to basket failed.
Add to Wish List failed.
Remove from Wish List failed.
Follow podcast failed
Unfollow podcast failed
From Weeks to Minutes: How Prompt-Based Experimentation Changes Everything
-
Narrated by:
-
By:
About this listen
In this episode of the Conversion Podcast, Matt is joined by Colin, Vice President of North America at Kameleoon, to explore prompt-based experimentation (PBX) and how AI is transforming the way experiments are built and launched.
Colin breaks down what PBX is, how it connects AI-driven “vibe coding” with experimentation, and why the build phase has long been the biggest bottleneck for experimentation teams. They discuss how PBX allows teams to create variants, tests, and prototypes directly on live websites using natural-language prompts, cutting build time from weeks or days down to minutes.
The episode also covers where PBX fits into the experimentation lifecycle, the importance of keeping humans in the loop, current limitations of the approach, and what adoption looks like for teams just getting started. They close with a discussion of the Prompt-a-thon, an open challenge designed to explore how far prompt-based experimentation can be pushed.
What is prompt-based experimentation (PBX) is
How PBX differs from AI coding and vibe-coding tools
Why building experiments is the biggest friction point
Human-in-the-loop experimentation with AI
Adoption tips and limitations
The Prompt-a-thon