Robots.txt Noindex Update: Everything SEOs Need to Know
Update: As of 1st September 2019, Google will be retiring all code that handles unsupported and unpublished rules in robots.txt…
Common Robots.txt Mistakes and How to Avoid Them
Robots.txt is a critical tool in an SEO’s arsenal, which is used to establish rules that instruct crawlers and robots…
Disallow and Google: An Intermediate SEO Guide
Following on from our beginner’s guide to implementing noindex, disallow and nofollow directives, we’re now taking a look at some…
Noindex and Google: A Guide for Intermediate SEOs
Following on from our beginner’s guide to implementing noindex, disallow and nofollow directives, we’re delving a bit further into the…
Noindex, Nofollow & Disallow
The three words above might sound like SEO gobbledegook, but they are definitely words worth knowing, since understanding how to…
How to Audit URLs Being Blocked By Robots.txt
When auditing websites that have experienced a drop in rankings and organic search traffic, it’s important to have a good…
Managing robots.txt Changes
Writing and making changes to a robots.txt file can make even the most hardened SEOs a little bit nervous. Just…