13 June 2023

How A $25B Company Uses A.I. To 300x Their Marketing Results (#129)

2Frameworks

7Insights

Frameworks in this episode

Marketing6 steps

AI Personalization With Human-in-the-Loop Validation

Generate tailored customer guidance, validate it live, then scale what proves useful

Read →

Marketing6 steps

AI Secret Shopper Loop

Continuously test customer journeys through a persona-trained AI agent

Read →

Insights & moments

The myth-busts, hot takes, explainers, and tools worth keeping.

Myth Buster· 1

Myth Buster17:30

Text-Only AI Cannot Fully Judge a Visual Email Experience

Automated critique becomes less reliable when an email depends on images, GIFs, or video to explain the product. Kieran notes that this makes Zapier's visual emails harder for an agent to evaluate than conventional text-based nurture messages.

Visual content can carry essential explanatory meaning
Forwarding email text alone creates an incomplete test
Basic text-heavy nurture flows are easier to evaluate
Multimodal understanding is an important implementation requirement

“how can it perfectly critique the email if it doesn't really understand the imagery or the video or the gifs.”
Kieran Flanagan · 18:00

#email marketing#multimodal ai#limitations#quality assurance

Hot Take· 2

Hot Take01:00

AI May Make Traffic Scarcer but Conversion Easier

Kipp predicts that AI-driven disruption to search and social media will make acquiring website traffic progressively harder. At the same time, businesses will gain stronger tools for converting and monetizing the visitors they do attract through highly customized experiences.

Search and social disruption may reduce dependable traffic acquisition
AI can make customer experiences more personalized
Conversion capability may improve even as audience acquisition becomes harder

“it's gonna be harder and harder for a business to go find and attract new customers in terms of bringing in new traffic to their…”
Kipp Bodnar · 01:00

#ai#conversion#traffic acquisition#personalization

Hot Take21:30

Marketers Have a Six-to-18-Month AI Conversion Window

Kipp argues that current AI marketing advantages will not remain equally scarce forever. He sees a near-term opportunity for marketers to deploy creative, evaluation, and personalization tools before these capabilities become standard across competing platforms and teams.

Some AI marketing capabilities will become commoditized
Early adopters can still capture meaningful conversion advantages
The estimated opportunity window is six to 18 months
Teams should update existing automation rather than preserve legacy workflows

“if you're a marketer for the next six to 18 months, there's a huge opportunity to leverage these tools to drastically change your conversion rate.”
Kipp Bodnar · 22:00

“Don't just sit there and do all of your conversion rate, your marketing automation, the way you used to.”
Kipp Bodnar · 23:30

#competitive advantage#ai adoption#conversion optimization#marketing strategy

Explainer· 1

Explainer19:30

A Multi-Agent Marketing System Could Critique and Improve Itself

Kieran extends the secret-shopper concept into a speculative multi-agent system. One agent creates marketing or sales content, another tests the customer journey, and a supervising agent translates the critique into instructions that improve future output.

A production agent can generate emails or sales sequences
A separate test agent can experience and critique the flow
Another agent can convert critiques into improvement instructions
The architecture reduces repeated human coordination

“you could imagine having like a bunch of AI agents critiquing parts of your go-to-market journey and having another AI agent taking those critiques and…”
Kieran Flanagan · 19:30

“Eventually you can just tell an AI agent, "You get better, and then you go create this stuff."”
Kieran Flanagan · 21:00

#ai agents#multi-agent systems#sales automation#feedback loops

Story· 1

Story02:30

Custom Midjourney Ads Cut The Hustle's Acquisition Cost by 300%

The Hustle replaced conventional stock-image advertising with custom Midjourney visuals closely matched to each ad's copy and value proposition. Kipp reports that the initial experiment produced a threefold improvement and reduced subscriber acquisition cost by 300%, though he expects the gain to moderate as spending scales.

Custom visuals were designed around each ad's exact message
The initial test performed three times better
Subscriber acquisition cost fell by 300%
The advantage may decline as the campaign reaches greater volume

“It reduced the cost per acquisition on subscribers by 300%.”
Kipp Bodnar · 03:30

“the images are hyper-personalized to the message, right? The copy in the image couldn't be more aligned.”
Kipp Bodnar · 04:00

#midjourney#advertising#the hustle#creative testing#cac

Takeaway· 2

Takeaway05:30

AI Commoditizes Execution, Not Great Creative Ideas

Kieran distinguishes push-button mass personalization from genuinely differentiated creative work. Standardized AI capabilities may quickly become expected, but original angles, humor, writing, and the ability to express an idea visually remain durable sources of advantage.

Push-button AI output will increasingly look the same
Platform-level personalization eventually becomes an expectation
Unique perspectives and strong writing remain differentiators
AI rewards skilled practitioners who know how to direct the tools

“great creative ideas and writing will never be commoditized.”
Kieran Flanagan · 06:00

“creativity, incredible ideas, unique perspective, angles, humor, great writing, being able to like take something in your brain and create that into an incredible image,…”
Kieran Flanagan · 08:00

#creativity#commoditization#differentiation#ai marketing

Takeaway08:30

AI Changes the Game When Marketing Gets Better and Faster

AI's conversion advantage is not simply cheaper or faster production. Its greater value comes from generating stronger assets while also shortening test-and-feedback cycles, allowing many small improvements to accumulate into a material result.

Conversion improves through repeated tests and feedback
AI accelerates the rate at which experiments can be run
Speed alone offers limited advantage
Higher quality combined with greater speed creates compounding value

“AI allows you to run those tests much faster, which is why I think AI is a huge lever for conversion rates.”
Kipp Bodnar · 09:00

“It's not that good if it's just faster. It's pretty good if it's better, but if it's better and faster, that's where the game changes.”
Kipp Bodnar · 09:30

#experimentation#conversion rate#speed#marketing operations