机器人.txt 生成器
构建 robots.txt 允许和不允许规则、扫描延迟和站点图指令。
每行一个路径,从 /. 编码空间为 %20 和 # 作为 %23。
robots.txt controls crawling; it does not secure private pages or guarantee removal from search. Google ignores Crawl-delay. One agent token per line (letters, _, -, or *).
robots.txtReview before publishing at the site root. Manual edits are copied and downloaded; changing form fields regenerates the file.