AI-First, Search-Verified Workflow
Use AI to discover possibilities and search to verify consequential facts
- Difficulty
- Easy
- Time to result
- ~days to results
- Steps
- 6
- Confidence
- 99%
Use generative AI as the discovery and first-pass layer, then switch to search and primary sources for verification. The model can suggest ideas, people, claims, quotations, or research directions much faster than manual exploration, but its creative design means plausible wording can be false. Identify every consequential factual claim, locate an independent source, and compare the source with the exact wording supplied by the model. Unsupported quotes should be removed rather than softened into apparent authenticity. This division of labor preserves speed while assigning distinct roles: AI expands the possibility space, and search plus source inspection establishes whether the selected material is real.
Origin
Extracted from Marketing Against The Grain after Kieran described using AI for most first passes and Google to verify its answers.
Core principles
- 01AI can accelerate the first pass by surfacing possibilities
- 02Generative fluency is not proof of factual accuracy
- 03Search works well as a verification layer after AI-assisted discovery
- 04Claims and quotations deserve extra caution
- 05The workflow gains speed only when verification remains explicit
How to run it
- 1
Run the AI First Pass
Ask the model to explore the topic, generate a draft, or identify promising claims and sources.
Pro tip Request source information alongside factual material, while treating it as unverified.
Watch out Do not publish or act on the raw response.
- 2
Mark Consequential Claims
Highlight facts, statistics, names, and quotations whose accuracy matters to the output or decision.
Pro tip Apply extra scrutiny to exact quotes and claims attributed to real people.
Watch out Fluent, specific wording can create false confidence.
- 3
Search Independently
Use search to find an authoritative or primary source for every marked claim.
Pro tip Search distinctive fragments of a quotation in quotation marks.
Watch out A search result snippet is not sufficient evidence by itself.
- 4
Inspect the Source
Open the source and confirm that it supports the exact claim, context, and attribution.
Pro tip Check surrounding text for qualifiers that the AI omitted.
Watch out A real source can still fail to support the model's wording.
- 5
Correct or Remove
Revise inaccurate claims and omit quotations that cannot be verified exactly.
Pro tip Prefer a smaller set of verified facts over a complete-looking unsupported draft.
- 6
Carry Evidence Forward
Store the citation or source alongside the final material so later users can repeat the check.
Watch out Do not detach the verified claim from the evidence during editing.
In the wild
Kieran used AI while preparing for an interview with Sophia Amoruso and received a compelling quotation attributed to her. He checked it independently and found that she had not said those words, so the quote could not safely be used as authentic.
→ Verification prevented a fabricated quotation from entering an interview.
Common mistakes
Treating AI as a Search Engine
The user assumes that a confident answer retrieves an existing fact rather than generating plausible language.
Verifying Only the General Idea
A source discusses the same topic, but it does not support the exact claim or quotation presented by the model.
Skipping Checks for Convenient Claims
The most useful or compelling claims receive less scrutiny precisely because the user wants them to be true.
Is it for you?
Best for
It is best for first-pass research, interview preparation, content development, and other work where AI can suggest useful directions.
Not ideal for
It is not ideal for high-stakes domains that require authoritative databases, professional review, or stronger evidence than general web search.
From the transcript
“what I do actually, which is really interesting because it does speak to what we talked about 18 months ago. You know what I use…”
“But I double checked and she didn't say those words. And so like you have to like really check.”
“ChatGPT isn't a search engine. It's meant to be creative, and so it will creatively answer things, right?”
From the episode
Answering Your Burning Questions On AI & Marketing