Block Internal Pages That Do Not Need To Be Indexed

Privacy policies, contact pages and other pages that are deemed necessary, but not needed to be indexed can be blocked in the robots.txt file. A robots.txt file tells most of the search engines, what you would like and not like them to have access to or index. Most major SERPs follow it's commands and the ones that don't are likely spam crawlers anyways.

More reading on robots.txt

Why would you care if they are blocked or not? You want you link juice to flow to pages that need it and use it for ranking. The less you split the juice the better. While not overly crucial, every bit helps. There is no sense to pass PR or link juice to those type of pages as they are their mostly to keep advertisers and affiliate programs happy and for on site surfers to read if they choose to.

You can use this robots.txt generator, to generate a robots.txt file for pages you want blocked from the SERPS and save that link juice for pages that need it and need more of it.

Related Posts by Categories