Tampa Internet Marketing

Tampa Internet Marketing with Mobile Responsive SEO Websites and Internet Video

You are here: Home / Tampa Internet Marketing - Google Optimization Tips / Should I block duplicate pages using robots.txt?

Should I block duplicate pages using robots.txt?

by

Halfdeck from Davis, CA asks: “If Google crawls 1000 pages/day, Googlebot crawling many dupe content pages may slow down indexing of a large site. In that scenario, do you recommend blocking dupes using robots.txt or is using META ROBOTS NOINDEX,NOFOLLOW a better alternative?” Short answer: No, don’t block them using robots.txt. Learn more about duplicate content here: www.google.com