25th November 2010, 10:48
#411
1 out of 1 members found this post helpful.
Controlling crawling and indexing now documented on code.google.com
Do you know how Google's crawler, Googlebot, handles conflicting directives in your robots.txt file? Do you know how to prevent a PDF file from being indexed? Do you know Googlebots favorite song? The answers to these questions (except for the last one

), along with lots of other information about controlling the crawling and indexing of your site, are now available on code.google.com
Krumel - apeleaza la serviciile oferite de mine prin formularul de pe blog.