R

RobotsReader

JetBrains

genai · v—

See what your robots.txt actually does — in plain language, right next to the file. Open any robots.txt and RobotsReader adds a live preview that decodes it, instead of leaving you to read raw Disallow lines. AI crawlers — a table of known AI bots (ClaudeBot, GPTBot, Google-Extended, Bytespider, CCBot…) showing which are blocked or allowed , by name or via *</co

Programming Language
Open in store ↗ id: 33457
Downloads
214
214
Rating
— ★
— ratings
Category
JetBrains Marketplace
Collected
2026-11-04
weekly snapshot

Similar in “Programming Language”