From: feld Date: Wed, 12 Aug 2020 16:19:34 +0000 (+0000) Subject: Update robots_txt.md X-Git-Url: https://git.squeep.com/?a=commitdiff_plain;h=3aa7969ff9c92ddd4b38caa91b453537ce11dcae;p=akkoma Update robots_txt.md --- diff --git a/docs/administration/CLI_tasks/robots_txt.md b/docs/administration/CLI_tasks/robots_txt.md index b1de0981b..844318cc8 100644 --- a/docs/administration/CLI_tasks/robots_txt.md +++ b/docs/administration/CLI_tasks/robots_txt.md @@ -1,8 +1,8 @@ -# Managing robot.txt +# Managing robots.txt {! backend/administration/CLI_tasks/general_cli_task_info.include !} -## Generate a new robot.txt file and add it to the static directory +## Generate a new robots.txt file and add it to the static directory The `robots.txt` that ships by default is permissive. It allows well-behaved search engines to index all of your instance's URIs.