bot traffic mitigation

Bad bots can chew through bandwidth, scrape content, and skew analyticswhile good crawlers (like search engines) still...