[dupe] https://news.ycombinator.com/item?id=49073513

My websites are not as big as Google or Reddit, and I take steps to block bot scraping.

I'm not interested in paying bandwidth costs for bots that don't care about what I posted.