| Crawler | Operator and purpose | Access |
|---|
Runs entirely in your browser. Nothing you type here is sent anywhere.
Runs in your browser, sends nothing anywhere
No signup, no email gate, no data leaving your machine. These are the first steps of our own process.
What to do with the output
Blocking a crawler is a legitimate choice. Blocking it by accident, then paying an agency to get cited by the system behind it, is not. Check first.
Note the distinction between training crawlers and retrieval crawlers. Blocking a training crawler keeps your content out of a future model. Blocking a retrieval crawler keeps you out of answers being generated right now, which is the one that costs you this quarter.
No email gate, on purpose
A tool behind a form is a lead magnet pretending to be a tool. These run entirely in your browser and nothing you type leaves your machine.
They are the first steps of our own process, published so you can run them yourself and decide whether you need anyone at all.
Twenty buying prompts, four engines, you against three named competitors. Report in one working day. No call needed.
AI crawler access checker: common questions
Does allowing these crawlers mean I get cited?
No. It is a precondition, not a cause. A blocked crawler guarantees absence; an allowed one only makes presence possible.
Should I block AI crawlers?
It depends on whether your content is the product. Publishers often should. Brands that want to be recommended almost never should, and many are blocking by accident through an inherited robots.txt.
What if a crawler is unspecified?
It falls under your wildcard rule. Unspecified plus a permissive wildcard means allowed. Unspecified plus a restrictive wildcard means blocked, which is where most accidental blocks come from.
See what the engines say about you
Twenty buying prompts, four engines, your brand against three named competitors. Report in one working day.
- 20 buying prompts, your category
- ChatGPT, Gemini, Perplexity, AI Overviews
- You against three named competitors
- Report in one working day, yours to keep