Stitch Did Not Ground Its Dashboard in Current Web Data
A request for a dashboard comparing current language models exposed a major limitation: Stitch generated a polished interface but populated it with stale or invented model information. Even supplying a source website did not make it reliably extract current data from that page.
- Visual generation does not guarantee factual accuracy
- The generated model data appeared to come from training data
- Explicit requests for current internet data were ineffective
- Providing a source website did not reliably ground the dashboard
“So it didn't look like it grounded from the internet because we can see this is all from 2024, which is probably when the sort…”
“Yeah, it doesn't appear to be able to pull information directly from the web to build out your dashboard, but we did get a dashboard…”