Vercel Knowledge Base
vercel.com backs 5 GrowthDex tactics. This page exists so readers and crawlers can follow the evidence trail from source to tactic.
Original source
Cited GrowthDex tactics
- Explicit AI-bot allowlist in robots.txtName the major AI crawlers in `robots.txt` and explicitly allow them instead of relying on a generic wildcard and hoping the agent interprets it the way you intended.
- AI-agent auto-detected markdown fallbackDetect likely agent requests and return markdown automatically, even when the client does not explicitly ask for it.
- Content-negotiated markdown on canonical URLsServe markdown from the same canonical URL when an agent requests `Accept: text/markdown`, instead of forcing a separate docs-only experience.
- Markdown shadow routes for direct agent retrievalGenerate a `.md` version for every important content URL so agents, IDEs, and operators can fetch clean text without special headers.
- sitemap.md semantic discovery mapPublish a Markdown sitemap with section labels and page descriptions so agents can understand the site structure before they start fetching individual pages.