index
:
doc
main
FreeBSD documentation tree
about
summary
refs
log
tree
commit
diff
log msg
author
committer
range
path:
root
/
en_US.ISO8859-1
/
htdocs
/
robots.txt
Commit message (
Expand
)
Author
Age
Files
Lines
*
remove testing robots.txt entry: it didn't help :(
Eitan Adler
2015-04-03
1
-1
/
+0
*
Re-add /cgi/url.cgi to the disallowed list, this is now served by Varnish.
Gavin Atkinson
2014-07-23
1
-0
/
+1
*
As of r45331, /cgi/pds.cgi and /cgi/url.cgi no longer exist.
Gavin Atkinson
2014-07-22
1
-2
/
+0
*
Re-enable indexing manual pages, jet is fixed.
Glen Barber
2013-12-29
1
-1
/
+1
*
Block man.cgi lookups until jet stops overheating.
Glen Barber
2013-12-29
1
-1
/
+1
*
Remove the restriction of indexing man.cgi.
Glen Barber
2013-10-04
1
-1
/
+1
*
Explicitly list the files within cgi/, since not all crawlers will
Glen Barber
2013-10-04
1
-1
/
+16
*
Remove a stray blank line from robots.txt.
Glen Barber
2013-10-04
1
-1
/
+1
*
Due to the time sensitive nature of some of the testing I'm doing, readd /sit...
Eitan Adler
2013-06-01
1
-0
/
+1
*
Sigh...
Glen Barber
2013-06-01
1
-1
/
+0
*
The folder blocked previously seems to be a special case of a broader problem...
Eitan Adler
2013-05-31
1
-2
/
+1
*
There appear to be configuration errors causing an absurd amount of links to ...
Eitan Adler
2013-05-31
1
-0
/
+4
*
- Remove junk directories.
Hiroki Sato
2012-05-17
1
-0
/
+4