A
AI Crawler Rules
JetBrainsreadystack · v—
Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI-search citation, or user fetch - and which lines silently do nothing. Right-click in the editor (or Tools ) → AI Crawler Rules: Check This File . Each finding appears on its line with the fix. 19 rules, offline. Runs the same engine as the VS Code extension and the CLI: npx @readystack/robots-txt-ai-crawler-audit (Node.js 18+ required). Free for the file y
Code Tools
Open in store ↗
id: 34708
Downloads
34
34
Rating
— ★
— ratings
Collected
2026-11-04
weekly snapshot
Similar in “Code Tools”
T
Translation
db774541-6493-458b-aa54-2835e97ce04f
4.1★
(286)
10.9M
Code Tools
J
JPA Buddy
JetBrains
4.1★
(255)
6.9M
Code Tools
J
JetBrains Academy
JetBrains
4.1★
(74)
6.3M
Code Tools
I
Issue Trackers
JetBrains
4.1★
(8)
5.8M
Code Tools
I
IDE Features Trainer
JetBrains
4.1★
(36)
3.6M
Code Tools
A
Alibaba Java Coding Guidelines
2fbe0286-ab66-4c1a-b8f5-b6b9884a1f45
4.1★
(48)
2.9M
Code Tools