Robots.txt Generator
* 通配与 $ 结束锚定(后者为广泛支持的扩展)。Disallow: / 为全站禁止;值为空则表示全部允许。| Item | Formula / Note | Source / Standard |
|---|---|---|
| Directive syntax | User-agent, Allow, Disallow, Sitemap grouped by agent | RFC 9309 |
| Matching | longest match wins; Allow wins ties against Disallow | RFC 9309 |
| Wildcards | * matches any sequence; $ anchors the path end | RFC 9309 |