Tag Archives: robots exclusion protocol
Robots.txt File
In the previous post on Search Engine Friendly Websites we learnt what search engine spiders are. Now we can look at what we can do to influence spidering behaviour. Spidering is an often overlooked part of SEO. If we write …
Continue reading
