Is it better to have a blank robots.txt file, a robots.txt that contains User-agent: * Disallow:” or no robots.txt file at all?” Corey S, Pennsylvania Have a question? Ask it in our Webmaster Help Forum: www.google.com Want your question to be answered on a video like this? Follow us on Twitter and look for an announcement when we take new questions: twitter.com More videos: www.youtube.com Webmaster Central Blog: googlewebmastercentral.blogspot.com Webmaster Central: www.google.com
You are here: Home / Tampa Internet Marketing - Google Optimization Tips / If I don’t need to block crawlers, should I create a robots.txt file?