The Official Google Blog says a bit about robots.txt, the file on your server that tells search engines how to access your site, what to index, and much more. From the OGB:
However, you may have a few pages on your site you don’t want in Google’s index. For example, you might have a directory that [...]
Lawyerist is the #1 law practice blog. We write about marketing, practice management, career development, and more.