Tuesday, 28 December 2010

Robot Txt File

I have added a robots.txt file to my site files to stop search engines finding my site in their searches. I did this because my site is not the official studio eleven site. However I did take the robots txt file off for a couple of weeks so search engines could find my site.

This is the code I used to stop search engines finding my site

User-agent:*
Disallow:/

* = Select all search engines
/ = Disallows access to the site

And this is the code to allow search engines to find my site

User-agent:*
Allow:/

* = Select all search engines
/ = Allow access to the site

No comments:

Post a Comment