Blogger: Tear down this (robots) wall!

Blogger photo hosting: http://photos1.blogger.com/robots.txt

User-agent: *
Disallow: /
These rules prevent all respectful robots from fetching Blogger-hosted images on posts. Unfortunately, that means that (among other things), the Internet Archive's saved historical records of blog posts may often lack the images to go with the text.

How about it, Blogger -- aren't the images important enough to allow robots to get them, too, whenever the author has allowed robots on the main text?

Technorati Tags: , , ,

Comments: Post a Comment