I wonder if this spider adheres to the robots.txt convention. And how to react if, for example, auction sites block it.

Teufelsgrinsen

At heise online news there's the original article.