Crawlability

Every AI answer that cites a website started with a successful fetch, so crawlability comes before everything else in this discipline: content the engines cannot read is content that does not exist for them, however brilliant. The modern failure modes are mostly self-inflicted and mostly invisible from a browser. CDN bot protection ships with defaults that challenge unfamiliar agents, and AI bots are the newest unfamiliar agents; JavaScript rendering hides content from crawlers that read only served HTML; slow origins burn crawler patience; and staging blocks migrate to production. Because your own browser sails past all of these, businesses discover the problem months late, usually by wondering why no engine ever cites them. The audit is mechanical: fetch key pages as each engine's bot would, check logs for the engines' user agents actually succeeding, and confirm the content you care about is present in raw served HTML. The check takes an hour, and every hour of content work is wasted while a crawler cannot open the pages.