[LinuxUsers] Using RAID? Read this ...

[Jeff Lasman]

On Saturday 03 January 2009 07:08 am, Rodney Myers wrote:

> > http://web.archive.org/web/*/http://journalspace.com
>
> Nothing on this redirected page;
>
> Robots.txt Query Exclusion.

Sorry I didn't make it more clear; that was my point.  They offered 
their users the option to either allow or disallow robots; the default 
appears to have been disallow, and the disallowed at the top level. If 
they'd only allowed at the top level, at least those users who wanted 
their blogs archived would have stood a better chance of being found.

Jeff
-- 
Jeff Lasman, Nobaloney Internet Services
P.O. Box 52200, Riverside, CA  92517
Our jplists address used on lists is for list email only
voice:  +1 951 643-5345, or see: 
"http://www.nobaloney.net/contactus.html"