AI SEO audit: can AI crawlers read your pages?
Google PageSpeed, robots.txt for the crawlers behind AI answers, llms.txt, your sitemap, structured data and what a crawler sees without JavaScript.
- One credit a page, back if unread
- Each finding with what to change
- Your competitors' homepages too
Indexing
Then, does Google have the page?
Search Console's answer for up to 500 pages your sitemap lists, each read at most once a day, when you open Indexing. Google's AI Overviews and AI Mode link only to pages Google has.
Tasks
Every finding becomes a task
What needs changing lands on your task list with its steps, under one name, so a problem found twice is still one task.
FAQ
Questions
- What is an AI SEO audit?
- A check of what stops AI assistants from reading and citing a page: crawlers turned away by robots.txt, words only JavaScript can show, missing structured data, a slow page. Site health runs one on any page of your site.
- How is it different from a technical SEO audit?
- It looks at the page through the crawlers behind AI answers as well as Google's: whether robots.txt lets them in, whether there is an llms.txt, and how many words they get without running JavaScript — beside Google PageSpeed's scores.
- Which AI crawlers does it check?
- The 13 that fetch pages for AI answers — OAI-SearchBot, ChatGPT-User, PerplexityBot, Perplexity-User and the rest. Blocking the ones that only collect training data is your call, and is not marked as a problem.
- What is llms.txt?
- A plain-text file at your site's root that gives AI tools a short map of the site. Site health says whether you have one; it is optional.
- Does it fix the problems?
- No. Each finding says what to change and becomes a task with its steps; the change itself is made on your site, by you or whoever runs it.
- Can I audit a competitor's site?
- Their homepage, from Site health's Competitors tab, beside your own.
- What does it cost?
- One credit a page, given back when the page cannot be read or Google PageSpeed does not run.
- Is there a free version?
- For single checks, yes: the robots.txt validator, the llms.txt generator and the AI crawler checker in Free tools need no account.
- Do you obey robots.txt?
- Yes. PassciteBot asks robots.txt before every read, at every redirect, and says why when it is turned away.
See who the engines recommend instead
The prompts your client loses, who wins them, and the tasks that would change it.