Robots Meta Tag
Yesterday we looked at how to use the Robot Exclusion Standard (that is your “robots.txt” file to you and me) that prevents spiders from visiting certain pages on your web site. Today we’re going to look at how to do the same with the Robots Meta Tag.
This is similar to your robots.txt file but [...]
Like this blog post?
Feel free to use the link below on your website or blog to link back to us:
http://www.returnondigital.com/blog/robots-meta-tag
Robots.txt File
In the previous post on Search Engine Friendly Websites we learnt what search engine spiders are. Now we can look at what we can do to influence spidering behaviour. Spidering is an often overlooked part of SEO. If we write a page of content and put in on the web, getting it spidered [...]
Like this blog post?
Feel free to use the link below on your website or blog to link back to us:
http://www.returnondigital.com/blog/29
