Robots.txt 生成器
为搜索引擎爬虫生成带有 allow/disallow 规则的 robots.txt 文件。
Rule 1
User-agent: * Allow: / Disallow: /admin Disallow: /private
Comments & Feedback
Comments are powered by Giscus. Sign in with GitHub to leave a comment.
为搜索引擎爬虫生成带有 allow/disallow 规则的 robots.txt 文件。
User-agent: * Allow: / Disallow: /admin Disallow: /private
Comments are powered by Giscus. Sign in with GitHub to leave a comment.