PubeWebsite/robots.txt

User-agent: *
Disallow: /docs/
Disallow: /img/
Disallow: /krypcolle/

Sitemap: https://pube.tk/sitemap.xml
Added robots.txt 2019-01-26 01:23:43 +02:00			`User-agent: *`
			`Disallow: /docs/`
			`Disallow: /img/`
Added KrypColle to robots.txt exceptions 2019-10-20 12:21:28 +03:00			`Disallow: /krypcolle/`
Included Sitemap 2019-01-26 19:46:54 +02:00
			`Sitemap: https://pube.tk/sitemap.xml`