Files
danbooru/app
evazion 74d77c1e23 Update robots.txt.
* Generate /robots.txt dynamically.
* Include link to sitemap.
* Update list of allowed urls.
* Disallow crawling of non-canonical subdomains.
2020-01-31 02:43:07 -06:00
..
2020-01-31 02:43:07 -06:00
2020-01-27 17:14:38 -06:00
2020-01-21 00:10:21 -06:00
2020-01-31 02:43:07 -06:00