Thursday, July 16, 2009

Don't index my newspaper site

I've been following the growing fight by some newspapers against Google indexing their site. They are angry that google spiders them & gets their traffic.

However now Google has responded by politely re-stating the very simple way any site can stop all search engines indexing them, by using the Robots Exclusion Protocol (REP).

Could it be that newspapers don't actually want Google to stop providing their content, they just want a share of Google's revenue? Perhaps.

No comments: