Add robots.txt

This commit is contained in:
Alex 2023-10-07 22:01:51 +03:00
parent f2d998f9d1
commit ccff4d72f3
Signed by untrusted user who does not match committer: enderice2
GPG Key ID: EACC3AD603BAB4DD

6
tools/website/robots.txt Normal file
View File

@ -0,0 +1,6 @@
User-agent: *
Disallow: /userspace/
Disallow: /modules/
Disallow: /kernel/
Disallow: /lynx/
Disallow: /fulldoc/