NewThe beta list is open. Join it
Tool 02·AI crawler rules//Free, in your browser

Decide which AI crawlers may visit.

Set each bot to allow or block and copy the robots.txt lines. Bots are grouped by what they do, so search and training are separate choices.

robots.txt rules
 

Add these lines to your existing robots.txt. A robots.txt file is a request, and well-behaved crawlers follow it. Some fetchers that act for a person may ignore it. Read robots.txt rules for AI crawlers for what each vendor says.

Beta·Early access

See which bots actually visit, and what they get.

Join the beta and LLMReady will test each bot against your live site and keep watching.