The msnbot search spider is running completely freaking amok on my weblog site right now. It is mostly getting 404 errors because it is looking for all kinds of crazy URLs, many of which appear to be stories from newspapers or other things that ain’t on this site. A typical URL path is ” /news/briefs/20040202/redsea.html” which of course I don’t have here. I suppose it’s a lot to ask of Microsoft to have a spider that actually works. Why should their server side be any different from their commercial products?
It Figures
Published by
