40% off on first monthClaim Now →
Free AI Crawler & robots.txt Checker

Can AI crawlers actually read your site?

We read your robots.txt and check whether GPTBot, ClaudeBot, PerplexityBot, Googlebot and other AI crawlers are allowed in. A silent block means you can never be cited.

We read your robots.txt, sitemap, and llms.txt. No signup. Takes a few seconds.

No signup requiredNo credit cardReads your real robots.txt100% free to run
How it works

If AI can’t crawl you, it can’t cite you

AI answer engines only cite pages their crawlers are allowed to read. One stray line in robots.txt, or a WAF rule, can quietly shut them all out. This free tool reads your public files and shows exactly who can get in.

1

We read your robots.txt

Tell us your domain. We fetch your robots.txt, sitemap, and llms.txt directly: no signup, no crawl of every page.

2

We test every AI crawler

For each AI user-agent (GPTBot, ClaudeBot, PerplexityBot, Googlebot and more) we resolve the exact rule that allows or blocks it.

3

We catch silent blocks

We flag crawlers that ignore robots.txt and answer engines your server or WAF blocks even when robots.txt allows them.

4

You get a clear fix

An accessibility score, which engines can cite you, and a copy-paste robots.txt that opens you up to AI answer engines.

AI is answering your customers. Make sure it mentions you.

Spyro writes citation-friendly pages, links them, and publishes to your CMS daily, so your brand is the answer AI engines and Google hand to your customers.