Recent Posts
Sebastian´s Pamphlets
Return To Blog Listing
Thoughts, findings, notes and opinions on Web development, Web search and SEO - not always serious and sometimes polemic.
Recent Posts Tagged With 'xml-sitemaps'
Get a grip on the Robots Exclusion Protocol (REP)
Thanks to the very nice folks over at SEOmoz I was able to prevent this site from becoming a kind of REP/robots.txt blog. Please consider reading this REP round up: Robots Exclusion Protocol 101 My REP 101 links to the various standards (robots...
My plea to Google - Please sanitize your REP revamps
Standardization of REP tags as robots.txt directives This draft is kinda request for comments for search engine staff and uber search geeks interested in the progress of Robots Exclusion Protocol (REP) standardization (actually, every search engine m...
Google to change the Robots Exclusion Protocol again
Web crawler directives, partly standardized in the Robots Exclusion Protocol (REP), evolved since 1994. Nowadays we’ve to deal with a conglomerate of not binding de facto standards and microformats, all of them extended by various organizations...
