Abhorrent_Anger
/
PubeWebsite
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity

Added KrypColle to robots.txt exceptions

This commit is contained in:
Abhorrent_Anger 2019-10-20 12:21:28 +03:00
parent 10f2c9bb15
commit b44b393fe0
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
robots.txt Normal file → Executable file
View File

@ -1,5 +1,6 @@
User-agent: * User-agent: *
Disallow: /docs/ Disallow: /docs/
Disallow: /img/ Disallow: /img/
Disallow: /krypcolle/
Sitemap: https://pube.tk/sitemap.xml Sitemap: https://pube.tk/sitemap.xml