Skip to main content

> GUIDE // FOUNDATIONS

Universal Agent Readiness Foundations

The core RFCs, bot rules, DNS-AID, and content signals required for full autonomous agent discoverability.

Executive Overview

Universal Agent Readiness is the discipline of architecting web origins so autonomous AI agents, crawlers, and LLM reasoning loops can reliably discover, negotiate, and interact with site services.

1. The 16 Agent Readiness Standards

Agent Readiness is structured across 5 distinct architectural pillars:

  1. Discoverability: robots.txt (RFC 9309), XML Sitemaps, RFC 8288 Link Headers, and DNS-AID (RFC 9460).
  2. Content Accessibility: Markdown Content Negotiation via Accept: text/markdown.
  3. Bot Access Control: Explicit AI crawler user-agent rules, Content-Signal preferences, and RFC 9421 Web Bot Auth.
  4. Protocol Discovery: API Catalog (RFC 9727), OAuth 2.0 (RFC 8414 & RFC 9728), Auth.md, SEP-1649 MCP Server Cards, Agent Skills RFC, WebMCP, and ARD Manifests.
  5. Agentic Commerce: Machine payment handshakes and programmatic escrow settlement.

Frequently Asked Questions

Why is HTML alone insufficient for AI agents?

HTML is designed for visual rendering and contains scripts, styles, and navigational chrome. Markdown content negotiation and RFC linksets provide clean token density and deterministic tool definitions.

AI Summary

Universal Agent Readiness is the discipline of architecting web origins so autonomous AI agents, crawlers, and LLM reasoning loops can reliably discover, negotiate, and interact with site services.