New AI Programs Should Prioritize Learning Before Metrics
Asana initially emphasized experimentation and first-principles learning rather than committing prematurely to performance targets. Metrics became more useful only after early usage supplied realistic baselines for the scale phase.
- Premature reporting can displace necessary exploration
- A new technology may require internal capability building
- Early data points enable more realistic targets later
- Headline AI targets may be arbitrary or deliberately easy
“if we overcommit on metrics and we just start reporting on metrics all the time we're not actually going to like spend the time learning”
“AI metrics are throwing spaghetti against a wall”