# Made by Max to limit the amount of traffic produced by crawlers. # Unfortunately many crawlers disregard this directive, but at least we try... # Temporarily (?) commented out: it seems that Google doesn't like it. # User-agent: * # valid for any crawler # Crawl-delay: 10 # wait 10 seconds between successive requests