Wednesday, January 13, 2010

More News International sites block aggregator

Following on from my post last Friday explaining how News International started blocking the news aggregation site www.newsnow.com, word is now out that other Murdoch-owned sites are following suit.

As revealed yesterday by PaidContent, The Sun and News Of The World were planning to block the search spider of NewsNow. However this has already started and The Sun's site has already implemented this change (Hat tip to Malcolm Coles for checking the robots.txt file on thesun.co.uk and getting proof)

There is still no reason given by NewsCorp on why NewsNow has been singled out for this treatment. Perhaps this is just the proof-of-concept before more search engines are excluded from their sites. NewsCorp may be looking at the effects on their organic search results and traffic as a consequence of excluding just one player in the news aggregation space......
Post a Comment