Files
danbooru/public/robots.txt
evazion bc34fb16a4 tags: automatically fix incorrect tag counts during maintenance.
* Automatically fix all tags with incorrect counts during daily
  maintenance (previously only tags with negative counts were fixed).
* Log fixed tags to NewRelic.
* Remove the ability to manually fix tag counts with the "Fix" button on
  the /tags listing. This is no longer necessary now that tags are
  fixed automatically.
2019-09-25 17:57:11 -05:00

54 lines
1.2 KiB
Plaintext

User-agent: *
Disallow: /admin
Disallow: /advertisements
Disallow: /artists
Disallow: /artist_commentaries
Disallow: /artist_commentary_versions
Disallow: /artist_versions
Disallow: /bans
Disallow: /comment_votes
Disallow: /comments
Disallow: /counts
Disallow: /delayed_jobs
Disallow: /dmails
Disallow: /favorite
Disallow: /iqdb_queries
Disallow: /ip_bans
Disallow: /janitor_trials
Disallow: /maintenance
Disallow: /m/
Disallow: /mod_actions
Disallow: /moderator
Disallow: /news_updates
Disallow: /note_versions
Disallow: /notes
Disallow: /pool_elements
Disallow: /pool_orders
Disallow: /pool_versions
Disallow: /post_appeals
Disallow: /post_flags
Disallow: /post_sets
Disallow: /post_versions
Disallow: /post_votes
Disallow: /posts.atom
Disallow: /posts/random
Disallow: /posts/copy_notes
Disallow: /posts/revert
Disallow: /reports
Disallow: /session
Disallow: /sources
Disallow: /static
Disallow: /tag_alias_corrections
Disallow: /tag_alias_requests
Disallow: /tag_aliases
Disallow: /tag_implication_requests
Disallow: /tag_implications
Disallow: /tags
Disallow: /uploads
Disallow: /user_feedback
Disallow: /users
Disallow: /wiki_page_versions
Disallow: /wiki_pages/new
Disallow: /wiki_pages/revert
Disallow: /wiki_pages/show_or_new