osem-fcy/public/robots.txt

# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
User-Agent: *
Allow: /
Disallow: /admin
First checkin 2013-01-07 09:04:09 +01:00			`# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file`
			`#`
			`# To ban all spiders from the entire site uncomment the next two lines:`
Allow in robots 2020-02-27 02:51:09 -08:00			`User-Agent: *`
			`Allow: /`
			`Disallow: /admin`