I love Microsoft's excuse: occasionally it ignores robots.txt because of programming bugs. Oh really. What kind of programming bugs might those be? Could that perhaps be the so-called Intentional Programming that Microsoft once thought so highly of?
At algorhythm you can find the original article.