From fae5e11012cbe3852b002dd9043cd538175ae2d3 Mon Sep 17 00:00:00 2001 From: r888888888 Date: Mon, 28 Dec 2015 12:32:57 -0800 Subject: [PATCH] modify robots.txt to exclude artists/new --- public/robots.txt | 1 + 1 file changed, 1 insertion(+) diff --git a/public/robots.txt b/public/robots.txt index 65d250f6b..8dfb6a71e 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,6 +1,7 @@ User-agent: * Disallow: /admin Disallow: /advertisements +Disallow: /artists/new Disallow: /artist_commentaries Disallow: /artist_commentary_versions Disallow: /artist_versions