diff options
| author | Wolfram Schneider <wosch@FreeBSD.org> | 2023-08-07 13:51:53 +0000 |
|---|---|---|
| committer | Wolfram Schneider <wosch@FreeBSD.org> | 2023-08-07 13:51:53 +0000 |
| commit | c048664e41ee40b03123d4370f89c7be217f9d39 (patch) | |
| tree | 2ab89cdba1d5cefa561ce63c387c60b678b956be | |
| parent | c186491c336c24630386803fcbbca0811056ace2 (diff) | |
| download | doc-c048664e41ee40b03123d4370f89c7be217f9d39.tar.gz doc-c048664e41ee40b03123d4370f89c7be217f9d39.zip | |
block GPTBot (OpenAI) from accessing cgi scripts
| -rw-r--r-- | website/themes/beastie/layouts/robots.txt | 4 |
1 files changed, 4 insertions, 0 deletions
diff --git a/website/themes/beastie/layouts/robots.txt b/website/themes/beastie/layouts/robots.txt index b94bcd43cf..ac0950c19f 100644 --- a/website/themes/beastie/layouts/robots.txt +++ b/website/themes/beastie/layouts/robots.txt @@ -17,3 +17,7 @@ Disallow: /cgi/query-pr.cgi Disallow: /cgi/search.cgi Disallow: /cgi/url.cgi Disallow: /statistic + +User-agent: GPTBot +Disallow: /cgi + |