Gojomo

2006-05-27
Blogger: Tear down this (robots) wall!

Blogger photo hosting: http://photos1.blogger.com/robots.txt

User-agent: *
Disallow: /
These rules prevent all respectful robots from fetching Blogger-hosted images on posts. Unfortunately, that means that (among other things), the Internet Archive's saved historical records of blog posts may often lack the images to go with the text.

How about it, Blogger -- aren't the images important enough to allow robots to get them, too, whenever the author has allowed robots on the main text?

Technorati Tags: , , ,

«»

Comments: Post a Comment

Front page
RSS Feed

News and opinion on technology, culture, business, politics, and the hidden meaning of it all.

About Gordon Mohr
My mug,
   
My employer,
   The Internet Archive
My project,
   Heritrix Crawler
My other weblog,
   Memesteading
Me at Twitter,
   @gojomo
My community metadata project (& company),
   Bitzi



Powered by Blogger Pro™