This commit is contained in:
Albert Yi
2010-02-04 15:08:49 -05:00
commit 9bb07046cd
41 changed files with 8425 additions and 0 deletions

5
public/robots.txt Normal file
View File

@@ -0,0 +1,5 @@
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
# User-Agent: *
# Disallow: /