Hi Matt, Could you give any insight into the sort of hardware and/or server-side software which power a typical Googlebot (web crawler) server? Tristan Perry, Cardiff, UK Have a question? Ask it in our Webmaster Help Forum: www.google.com Want your … [Read more...]
Don’t block Googlebot from crawling JavaScript and CSS
Have a question? Ask it in our Webmaster Help Forum: groups.google.com Want your question to be answered on a video like this? Follow us on Twitter and look for an announcement when we take new questions: twitter.com More videos: www.youtube.com … [Read more...]
Submit to index via Google Webmaster Tools
Matt Cutts explains how to submit URLs to Google's index. Learn more about this feature in the Webmaster Tools Help Center: www.google.com Have a question? Ask it in our Webmaster Help Forum: www.google.com Want your question to be answered on a … [Read more...]
Does Googlebot use inference when crawling?
Leon from the UK asks: "Does GoogleBot use inference when spidering - having crawled site.com/article/page1.htm and /page2.htm, can it guess at the existence of a /page3.htm and crawl it? Or does it stick entirely to what it finds via the link graph … [Read more...]