io.github.jmshinhwa/robots-txt-ai-crawler-audit
MCP serverMCP registryUnknown
Checks robots.txt line by line and says what each AI crawler token actually controls - training, AI
Description provenance: Original source
Measured: Sep 22, 2026 · 9 observations
Source evidence
- Source
- MCP registry
- Last activity
- No activity date supplied
- observations
- 9
Fit to your task has not been evaluated.
Comparable readings are grouped by signal and unit.
Measured signals
- Downloads · last 7 days
- 365
- downloads
- Measured · Sep 22, 2026
Momentum
- momentum score
- 42.7
- Window
- 7 days
- Public signals
- Estimated
Domains & Uses
- Domains
- Agents, skills and MCP
Installation
claude mcp add robots-txt-ai-crawler-audit -- npx @readystack/robots-txt-ai-crawler-auditMeasurement history
Comparable readings are grouped by signal and unit.
Downloads · last 7 days
One measurement only — no trend yet.
Exact values
| Measured | Public signals |
|---|---|
| Sep 22, 2026 | 365 downloads |
Classifications
- Nature
- Tool