Robots.txt Tester
Test whether a URL path is allowed or disallowed for a given crawler against pasted robots.txt content. Applies RFC 9309 precedence — longest matching rule wins, Allow beats Disallow on a tie, with */$ wildcards and most-specific user-agent group selection. Shows the exact rule that decided the verdict.
Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Body
Response
Tool output
The tool's slug, echoing the {slug} in the request path.
Output-contract version for this tool.
Credits this call consumed, after any settlement refund. 0 when metering is disabled.
Credits left in the current monthly allowance, or null when metering is disabled.
Correlation id, also sent as x-request-id.