Is your website ready for AI agents? Paste a URL. In about 10 seconds you'll see what could stop ChatGPT, Claude and other AI agents from reaching and reading your site, plus a plain-English fix for every gap.
No signup
Results in about 10 seconds
Read-only, public pages only
Sample report
74
yourbusiness.com
Mostly agent ready
✓robots.txt
✓Readable without JavaScript
!AI bot rulesneeds work
✕Markdown for agentsmissing
✓Structured data
How to fix itCopy prompt
Fetching robots.txt...
0/ 100
My own site, scored
20Cloudflare's score for ryandoser.com on September 14, 2026
→
60Cloudflare's score after one day of fixes with Claude Code (Level 4)
100Same site on this checker's default score, which uses different checks and weights (77 with all 20 checks counted)
The basics
What is AI agent readiness?
AI agent readiness is how easily an AI agent can reach your website, read it and act on it without a person clicking around for it. The agent might be ChatGPT fetching your page to answer a question, Claude researching vendors for someone, or a coding agent like Claude Code reading your docs.
For decades, websites were built for two visitors: people in browsers and search engine crawlers. Agents are a third visitor, and they read your site differently.
Here's a common example. A site built as a single-page app looks perfect in your browser. But the HTML it actually sends is an empty shell, and the text only appears after JavaScript runs. An agent that doesn't run JavaScript gets a blank page and moves on to a competitor.
So the question this checker answers is simple. When an agent shows up, does your site help it or fight it?
The opportunity
Why agent readiness matters (and why almost nobody has it yet)
Cloudflare put numbers on this when it launched its own scanner in April 2026. Its Radar team started from the 200,000 most visited domains on the internet, filtered out redirects, ad servers and tunneling services, and found:
78%have a robots.txt file
4%state their AI usage preferences in it
3.9%serve markdown when an agent asks
<15sites publish MCP Server Cards or API Catalogs
That gap is the opportunity. Some fixes take five minutes. Others depend on how your site is built. Either way, Cloudflare's numbers show the newer agent standards are still rare, so most sites haven't adopted them yet.
Markdown is a good example of why this matters. Agents pay for every token they read (a token is a small chunk of text). Cloudflare measured up to an 80% token reduction in some cases when an agent gets markdown instead of HTML. Fewer tokens means an agent can read more of your site before it runs out of room.
Under the hood
What this agent readiness checker tests
The checker runs 21 checks in five groups. It follows the same open standards as Cloudflare's isitagentready.com, and adds three practical checks for the problems I see most on real business sites: text hidden behind JavaScript, missing structured data, and firewalls that quietly turn AI agents away. It leaves out Cloudflare's commerce checks (x402, UCP and ACP), which don't count toward Cloudflare's score either.
Discoverability
Can an agent find your pages and the files that describe your site?
robots.txtA real robots.txt served as text, not your homepage HTMLEvery site
XML sitemapA valid sitemap that robots.txt points toEvery site
Agent Link headersHTTP headers pointing agents to llms.txt, markdown or API docsEvery site
llms.txtA markdown map of your key pagesOptional
Readable content
Can an agent read your pages without a browser, without wasting tokens?
Readable without JavaScriptReal text in the raw HTML, before any script runsEvery site
Markdown for agentsA markdown version when an agent asks for text/markdownEvery site
Structured dataschema.org JSON-LD describing your business and pagesEvery site
Bot access rules
Do you tell AI bots what they may do, and does your firewall agree?
AI bot rulesWhich of 13 AI bots your robots.txt allows or blocksEvery site
Content SignalsYour search, ai-input and ai-train choicesEvery site
Firewall test (simulated)Whether a simulated ChatGPT-User request gets turned awayEvery site
Web Bot AuthA key directory for signed bot requests (shown, not scored)Sites that run bots
Agent tools
Can an agent take an action on your site instead of just reading it?
Agent Skills indexInstruction files that teach an agent your siteNice to have
WebMCPTools your page hands to browser agentsSites with actions to offer
AI catalogOne manifest listing your agent-facing filesOptional
API, login and MCP
Only scored if you run an API, an app with a login, or an MCP server.
API catalogRFC 9727 list of your APIsAPI owners
OAuth discoveryWhere an agent logs in to your appApps with logins
OAuth protected resourceWhich login server your API trustsAPI owners
MCP Server CardHow agents find your MCP serverMCP server owners
A2A Agent CardA profile for an AI agent you runAgent operators
auth.mdPlain-language signup steps for agentsApps with logins
DNS-AIDAgent discovery records in DNSLarge agent services
Scoring
How the score works
Each check carries a weight based on how much it affects a real agent. Text readable without JavaScript (weight 14) and AI bot rules (12) count the most, because a failure there can lock agents out completely. robots.txt (10) and your sitemap (8) come next, since they tell every bot what exists and what's allowed. Draft standards like the AI catalog and DNS-AID count the least. A warning earns half credit, and the Web Bot Auth check is shown for context but never scored.
Your report shows one score out of 100. By default it grades 13 general website checks and skips the API, login and MCP group. Most of the 13 are basics every site needs. Four are low-weight extras (llms.txt, Agent Skills, WebMCP and the AI catalog), worth 11 of the 87 weight points combined.
Default score weights
Readable without JavaScript14
AI bot rules12
robots.txt10
XML sitemap8
Markdown for agents8
Structured data8
Firewall test8
Content Signals5
llms.txt3
Agent Link headers3
Agent Skills index3
WebMCP3
AI catalog2
Here's why the API group is left out. On September 14, 2026, Cloudflare's scanner gave ryandoser.com a 20 out of 100. After a day of fixes with Claude Code, it reached 60 and Level 4, "Agent-Integrated." Every check still failing was for an API, a login system, an MCP server or an AI agent, none of which a blog runs. Publishing fake versions of those files to chase a number would only feed agents bad information.
If you do run an API, an app or an MCP server, tick the box in your report. The score then grades all 20 scored checks.
For the record, ryandoser.com scores 100 on the default score here and 77 with the API group counted. The gap between that 77 and Cloudflare's 60 comes from weighting. This checker puts more weight on the basics every site needs, and it adds three checks Cloudflare doesn't run, which the site passes.
Fix order
How to make your website AI agent friendly
If you run a normal business, content or ecommerce site, fix things in this order. Each fix in your report comes with a prompt you can paste into Claude Code or any coding agent.
1
Make your text readable without JavaScript
Many AI crawlers fetch the raw HTML and don't run scripts. Sites built as single-page apps (plain React or Vue, some site builders) can look empty to them. Server-side rendering or static generation fixes it.
Biggest impact
2
Stop turning away AI search bots
Check robots.txt and your firewall. Security plugins and CDN bot settings can block AI agents even when robots.txt welcomes them.
Biggest impact
3
Add structured data
schema.org markup labels who you are, what you sell and who wrote what, so an agent doesn't have to infer it.
Biggest impact
4
Point robots.txt at your sitemap
One line. It's the cheapest way to hand an agent a list of your pages.
5
State your AI policy with Content Signals
One more line in robots.txt with your yes or no for search, AI answers and AI training. It records your preference. Bots aren't forced to follow it.
6
Serve markdown to agents that ask for it
On Cloudflare, paid plans can switch this on with a toggle. On other hosts, a small piece of middleware can serve a markdown copy of each page.
7
Then the extras
Link headers, an Agent Skills index and WebMCP tools help when you have something worth describing or an action worth offering. Skip them until the basics pass.
A perfect score won't get you recommended by ChatGPT.
Readiness covers what happens once an agent arrives. Getting named in an AI answer in the first place is a different job, and it runs on your content, your brand and what other sites say about you. Cloudflare's own launch post doesn't call its score a ranking factor, and neither should anyone selling you a fix.
Same goes for llms.txt. Google says you don't need AI text files to appear in its AI features, and there's no demonstrated citation benefit. That's why it carries one of the smallest weights here. I covered the evidence in the AI search myths post. If AI search visibility is the actual goal, start by tracking where you show up today, then look at the AI visibility tools worth paying for.
Readiness is the floor. It makes sure agents can get to the information you publish and understand it when they do.
FAQ
Frequently asked questions
Is my website optimized for AI agents?
Run the checker above and look at three results first: Readable without JavaScript, the firewall test, and whether AI bot rules shows a search or assistant bot as blocked. If none of those are red, our scanner could reach and read the page it tested, which is a good sign for most AI agents and most of the battle for a normal business site. A yellow "no stated policy" warning on AI bot rules is worth fixing, but bots are still allowed in. Markdown, Content Signals and the agent tools are the next layer.
What is a good agent readiness score?
These are this checker's own benchmarks: 70 and up is solid for a content or business site, and 90 and up is excellent. The default score skips the API, login and MCP checks, since a blog or service business doesn't need those files. If you run an API or an app, the checkbox in your report adds them in.
Does agent readiness help my SEO or AI search rankings?
Not directly. Whether ChatGPT or Google AI Overviews recommend you comes down to your content and your reputation across the web. The overlap is access. If you block AI search bots or hide your text behind JavaScript, AI search tools can't cite pages they can't read.
How is this different from Cloudflare's isitagentready.com?
Cloudflare's scanner set the bar, and this checker tests the same specs. Both give you fix prompts. Two things are different here. The default score grades content sites without docking them for API and login files they don't need. And it adds three checks Cloudflare's scanner doesn't run: text without JavaScript, structured data and a firewall test.
Should I block AI bots?
Blocking training bots like GPTBot and ClaudeBot is a fair business call. Think hard before blocking the search bots (OAI-SearchBot, Claude-SearchBot, PerplexityBot), because they decide whether your pages can show up in AI search results. The user bots (ChatGPT-User, Claude-User, Perplexity-User) visit a page when a person asks an assistant to read it. OpenAI says robots.txt rules may not apply to those user-requested visits, so a firewall rule is the reliable way to stop them.
Is the checker free? Do you save my results?
Free, no signup, no email. Each result is cached for 10 minutes so repeat scans and share links load fast, then it expires. The scanner only makes read-only requests to public URLs on the site you enter.
Stats on this page come from Cloudflare's April 2026 post, Introducing the Agent Readiness score. Cloudflare updates its Radar adoption data weekly, so current numbers may differ.
The AI SEO System I use to rank in Google & AI search. Runs in Claude or any AI setup.