MMarketing Against The Grain
← All episodes
17 December 2024

We Built a Custom AI Content Grader in 5 Minutes (No Code)

7Frameworks
12Insights

Listen

Frameworks in this episode

Insights & moments

The myth-busts, hot takes, explainers, and tools worth keeping.

Hot Take· 1

Hot Take19:30

AI Turned a WhatsApp Idea Into an MVP in Under 24 Hours

The hosts argue that AI dramatically compresses the distance between an idea and a functioning minimal version. Their audience-guide concept progressed from a message and an early draft to a live web-app prototype during the podcast, work that previously would likely have stopped at discussion.

  • Move from idea to prototype without assembling a traditional project team
  • Use minimal versions to test concepts that would otherwise remain hypothetical
  • Build personalized one-to-one software for narrow internal needs
  • Treat accelerated learning as a major benefit of AI prototyping

It is so easy to create personalized one to one software.

19:30

That's less than 24 hours. We've gone from WhatsApp to minimal viable version of web app.

20:30
#mvp#prototyping#personalized-software#ai-development

Explainer· 3

Explainer05:00

Where Vision AI Could Deliver Practical Feedback

The hosts explore knowledge-work applications for AI that can see and hear. They identify user-testing analysis, podcast critique, conference-speaking feedback, and audience-specific presentation rehearsal as promising uses.

  • Analyze recordings of users navigating product or website flows
  • Critique who speaks too much and where a podcast loses focus
  • Assess stage presence, mannerisms, confidence, and tone
  • Simulate an audience while reviewing a rehearsal

You do a bunch of user tests recording people interacting through a flow, product flow, website flow, whatever, and then have it summarize and give…

05:30

You could imagine, like if you're prepping for a meeting or a presentation, giving it the audience guide and then doing that video presentation and…

06:30
#vision-ai#user-research#presentations#feedback
Explainer11:00

What Claude Included in a Detailed Audience Guide

Claude transformed a customer profile into an extensive audience guide covering reader roles, voice, language, content structure, hooks, trust signals, formats, and useful phrases. The result went beyond demographics by specifying how content should be constructed for that reader.

  • Describe the reader's role and professional context
  • Define voice attributes and preferred language
  • Specify formats, lengths, and structural conventions
  • Document hooks, content angles, and trust signals
  • Include preferred phrases and practical content expectations

Then it has tone and voice. So it talks about the core voice attributes it got really specific again like language style really good uh…

11:30

So like how do you create attention hooks? So how do you actually get Growth Gabby hooked into the content, efficiency gains, data driven insights,…

12:00
#audience-guide#claude#content-design#personas
Explainer22:00

Three Data Sources That Deepen an AI Audience Profile

The hosts identify three broad inputs for improving an audience profile: unstructured customer communications, existing company collateral, and new interviews conducted by an AI avatar. Together these sources reveal why customers arrive, what the company already knows, and what target personas say when questioned directly.

  • Mine discovery calls and emails for pains and motivations
  • Review the customer journey for missing AI-useful information
  • Add product marketing research, sales decks, and other collateral
  • Use AI-led interviews to gather new qualitative evidence
  • Feed interview transcripts back into the audience repository

So there's three buckets, right? I would categorize them this way.

22:00

The second one is just all of the collateral you have, right?

22:30
#customer-data#audience-research#interviews#ai-agent

Story· 2

Story12:30

How the Audience Guide Repaired a Weak Content Hook

Claude graded a HubSpot PDF against the audience guide and found that its opening lacked the data and efficiency framing valued by the target reader. It then surfaced stronger statistics from later in the document and rewrote the introduction around the reader's immediate problem.

  • Grade existing content against explicit audience criteria
  • Check whether the opening uses the audience's preferred hooks
  • Reuse relevant evidence already present elsewhere in the source
  • Lead with the target reader's problem and measurable impact

if it's following our audience style guide, it's missing the core hook. It doesn't actually have a hook, doesn't have any data, doesn't talk about…

13:00

So straight away, it's hooked you with the problem using data.

13:30
#content-grading#hooks#copywriting#audience
Story17:30

Claude Built a Working Content Grader During the Conversation

While discussing the audience guide, one host asked Claude to turn the idea into a web app. The generated grader accepted an audience guide and pasted content, then scored the content across voice, tone, structure, engagement, and technical criteria.

  • Provide the audience guide as the grading standard
  • Paste content into a lightweight generated web app
  • Score voice, tone, structure, engagement, and technical detail
  • Use the feedback to identify missing headers, metrics, and reader concerns
  • Prototype personalized internal software through natural-language instructions

I've basically just built a content grader. It's basically given us a grade of 38%.

18:00

The functionality is simple. We add our audience style guide and then be able to paste in text based on content to grade against the…

18:30
#content-grader#no-code#claude#web-app#prototype

Q&A· 1

Q&A15:00

The Simplest Way to Share Audience Guidance With a Team

For small teams, the hosts recommend distributing the audience guide as a PDF that each writer uploads alongside their content. They also discuss keeping the guide in Google Docs for Gemini-assisted drafting and moving drafts into Claude for stronger writing.

  • Distribute one portable audience-guide PDF
  • Upload the guide whenever drafting or reviewing content
  • Store the guide in Google Docs when using Gemini
  • Use Gemini for retrieval and remixing, then Claude for rewriting
  • Consider a lightweight app when repeated manual uploads become cumbersome

Like you just get the PDF and you ask your team to upload it anytime you want to write something to check against.

15:30

But I think I think for small teams, PDFs. Everyone has a PDF, they upload it, or you could do this.

17:30
#team-workflow#pdf#content-operations#claude#gemini

Tool· 2

Tool02:00

Match Each AI Assistant to Its Strongest Context

The hosts use different assistants according to the information and integrations each one handles best. Grok covers real-time information, Claude handles personal assistance and writing, Gemini works across Google Drive, and ChatGPT serves as a fallback for comparison.

  • Use Grok for real-time news and verification
  • Segment Claude assistants by specialist domain
  • Use Gemini to retrieve and synthesize Google Drive material
  • Compare important outputs with another model

Grock is my real-time AI. If you need something with real time, you're going with Grok.

02:30

Gemini is now my personal assistant for Google Drive.

03:00
#ai-tools#grok#claude#gemini#workflow
Tool09:30

Use Gemini to Find Customer Research Across Google Drive

Gemini searched a large collection of internal Google documents and assembled a one-page profile of HubSpot's ideal customer. This avoided the usual process of asking colleagues for links or relying on the first document returned by search.

  • Ask Gemini to synthesize customer research across existing documents
  • Use source links to trace findings back to internal evidence
  • Consolidate scattered persona research into a usable profile
  • Reduce time lost locating the correct internal document

can you build a profile of HubSpot's ideal customer based on all of the research you can find about customer in my docs?

09:30

It builds you an actual one pager of Husband's customer, and then it kind of shows you all of the different sources.

10:00
#gemini#google-drive#customer-research#enterprise-ai

Takeaway· 3

Takeaway07:00

Writing Style Alone Is Not Enough for Strong AI Content

A previous writing-style experiment revealed that stylistic examples were insufficient without a detailed description of the intended reader. The hosts argue that audience clarity must accompany writing guidance for AI-generated content to become relevant and persuasive.

  • Pair writing-style instructions with audience details
  • Define who the content is for before asking AI to draft
  • Treat audience profiles as companions to writing styles
  • Expect more relevant output when the reader is explicit

the more information we gave Claude or Chat GPT about the audience itself, the better the output was.

07:00

the writing style mattered, but we needed to apply that writing style to the details of the audience and who it was being written for.

07:30
#audience#ai-writing#content-strategy#personalization
Takeaway20:30

The Scalable Version Is an AI Editor Inside the CMS

For a larger organization, the hosts envision placing the audience-aware grader directly in the publishing workflow. An agent would review content before publication, return errors for correction, and prevent publishing until the content conforms to the audience and style guidance.

  • Integrate audience checks into the CMS rather than relying on manual uploads
  • Make the agent an independent pre-publication editor
  • Return failed checks to writers for correction
  • Block publication until required issues are resolved
  • Apply AI consistently across the broader media workflow

your agent becomes the editor and has to like send you back and it doesn't post until you've corrected the errors or you fed it…

21:00

Yeah, you just build it into the CMS workflow.

21:00
#cms#ai-editor#content-governance#workflow-automation
Takeaway23:30

Go Beyond Interviews With Screen Behavior and Public Data

The proposed research process extends beyond conversational interviews. Participants should walk through products and content on screen so an agent can capture confusing words, weak statistics, and page-use behavior, while public discussions from forums and social platforms add another source of unstructured audience evidence.

  • Observe people using content and products on screen
  • Capture language that confuses customers
  • Identify which statistics resonate or fail
  • Study how customers navigate and consume individual pages
  • Gather relevant public discussions from forums, Reddit, and X

I think you want people to walk through your content and product detail, like on a video on screen, not just have a conversation so…

23:30

I think wherever your customers hang out, if you can go pull that information, because again, that's all unstructured data you can add into the…

24:30
#user-research#public-data#forums#screen-analysis