diff options
| author | Sergio Carlavilla Delgado <carlavilla@FreeBSD.org> | 2022-12-10 11:10:07 +0000 |
|---|---|---|
| committer | Sergio Carlavilla Delgado <carlavilla@FreeBSD.org> | 2022-12-10 11:11:01 +0000 |
| commit | a0f41809ca112eb4eb5e98f7d0921e65f7cb0ee2 (patch) | |
| tree | 34b31d1eba8aa22c2b780687352691fa42216143 | |
| parent | 64839d3cea26be68000c206c4d90b3076e2b3011 (diff) | |
| download | doc-a0f41809ca112eb4eb5e98f7d0921e65f7cb0ee2.tar.gz doc-a0f41809ca112eb4eb5e98f7d0921e65f7cb0ee2.zip | |
Improve SEO of the Documentation Portal
* Remove SVN tag
* Stop indexing the archive
| -rw-r--r-- | documentation/themes/beastie/layouts/robots.txt | 4 |
1 files changed, 2 insertions, 2 deletions
diff --git a/documentation/themes/beastie/layouts/robots.txt b/documentation/themes/beastie/layouts/robots.txt index b94bcd43cf..d5ac9c0dbd 100644 --- a/documentation/themes/beastie/layouts/robots.txt +++ b/documentation/themes/beastie/layouts/robots.txt @@ -1,5 +1,3 @@ -# $FreeBSD$ - User-agent: * #Crawl-delay: 10 Disallow: /cgi/confirm-code.cgi @@ -17,3 +15,5 @@ Disallow: /cgi/query-pr.cgi Disallow: /cgi/search.cgi Disallow: /cgi/url.cgi Disallow: /statistic +Disallow: /statistic +Disallow: /doc |