Thanks for replying. Yes I am ware of the harming effect a crawler can have on the network, but I think it is better to have an optimized crawler (open source), than to let amatuers develop their own crawlers. I'll ask in that group, thank you.