Why AI Cannot Reliably Explain What Makes Great Writing Great
A test using David Ogilvy's Rolls-Royce advertisement shows that a model can identify broadly correct writing traits without uncovering the distinctive craft behind the work. Its analysis defaults to familiar best practices rather than expert-level insight into why a particular piece succeeds.
- The model's initial observations were correct but generic
- Repeated requests produced sharper labels without deepening the analysis much
- Models average patterns from training data rather than exercising elite creative judgment
- Expert human insight is still needed to define what exceptional work looks like
“Everything I've noticed is like super generic.”
“AI is not good at getting you the deep insights in the way a human would”