Or paste your robots.txt content directly below
Quick test:
0
AI Crawler Score
Calculating...
Analysis...
Blocked AI Crawlers
Allowed AI Crawlers
Recommendations
Corrected robots.txt file — PRO only
Get the fixed file ready to deploy
Go deeper
robots.txt is one signal out of 30.
A full AI Audit Scan checks 6 pillars — structured data, entity clarity, content extractability, publisher signals, and more — across ChatGPT, Gemini, Perplexity and Claude.
Get My Full AI Audit →Free · No credit card · Results in 60 seconds