← Answers
Answers · AEO

How do I check whether ChatGPT can read my website?

Short answer. Check three things: that robots.txt does not block the AI crawlers, that the server answers them with the page and not an error or a challenge, and that the page's text is in the HTML and not added later by scripts. Then do a cold read: give an assistant only your homepage text and ask what the company does.
Updated ·by zRev

Step one: robots.txt

Open yoursite.com/robots.txt and look for rules naming GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot or PerplexityBot. A Disallow of a single slash under any of them, or under a wildcard, blocks that reader from the whole site.

Step two: what the server actually returns

A permissive robots.txt is not the end of it. Security and bot-protection layers often refuse anything that is not a browser. Request a page while identifying as one of those crawlers and look at the status. A 403, a 429 or a challenge page means the crawler is turned away at the door, whatever robots.txt says.

Step three: is the text really there?

Many crawlers do not run scripts. View the page source, not the rendered page, and search for a sentence from your main copy. If it is missing, the content is being added in the browser and a crawler sees an empty shell.

Step four: the cold read

Paste the visible text of your homepage into an assistant and ask what the company does, who it is for and what evidence there is. What it cannot answer is what your page does not say. This is the test that catches vague positioning, which no technical fix repairs. Repeat all four steps after any redesign or change of hosting, since those are the moments a block or a script-only page slips in unnoticed.

Related

Want this built inside your own stack? Book a call, or ask the concierge in the nav.

© 2026 zRev Solutions
FAQ Insights Privacy & Terms