| Rev | Author | Line No. | Line |
|---|---|---|---|
| 367 | miho | 1 | # robots.txt |
| 2 | # |
||
| 3 | # Some directories should not be searched because they are dynamically generated |
||
| 4 | # and they create link loops. |
||
| 5 | # |
||
| 6 | # Robots Exclusion Standard: |
||
| 7 | # http://www.robotstxt.org/wc/exclusion.html#robotstxt |
||
| 8 | # |
||
| 9 | # User-agent: <agent-string> |
||
| 10 | # Disallow: <path> |
||
| 11 | # ----------------------------------------------------------------------------- |
||
| 12 | |||
| 13 | User-agent: * |
||
| 14 | Disallow: /WebSVN/ |
||
| 15 | Disallow: /Web/Maintenance/ |