Recent Posts Tagged With 'url removal'

• About the bad taste of shameless ego food

  Posted on Friday January 30th, 2009 at 17:15 in SEO, robots.txt, robots meta tags, x-robots-tag, ego food, url removal

  Seems I’ve made it on the short-list at the SEMMY 2009 Awards in the Search Tech category. Great ego food. I’m honored. Thanks for nominating me that often! And thanks to John Andrews and Todd Mintz for the kind judgement! Now that you...

• @ALL: Give Google your feedback on NOINDEX, but read this pamphlet beforehand!

  Posted on Monday February 25th, 2008 at 05:08 in robots.txt, search quality, crawler directives, robots meta tags, x-robots-tag, url removal

  Matt Cutts asks us How should Google handle NOINDEX? That’s a tough question worth thinking twice before you submit a comment to Matt’s post. Here is Matt’s question, all the background information you need, and my opinion. What is ...

• Get a grip on the Robots Exclusion Protocol (REP)

  Posted on Thursday January 17th, 2008 at 08:26 in web development, microformats, robots.txt, crawler directives, robots meta tags, x-robots-tag, xml-sitemaps, url removal

  Thanks to the very nice folks over at SEOmoz I was able to prevent this site from becoming a kind of REP/robots.txt blog. Please consider reading this REP round up: Robots Exclusion Protocol 101 My REP 101  links to the various standards (robots...

• Getting URLs outta Google - the good, the popular, and the definitive way

  Posted on Monday January 14th, 2008 at 15:01 in web development, duplicate content, webmaster central, robots.txt, crawler directives, robots meta tags, x-robots-tag, url removal

  There’s more and more robots.txt talk in the SEOsphere lately. That’s a good thing in my opinion, because the good old robots.txt’s power is underestimated. Unfortunately it’s quite often misused or even abused too, usually be...