This is concerning. It's clear we need some level of societal backlash to halt and reverse this.

Society has no true frame of reference for such exponential growth. I see a parallel to COVID. It was not a big deal on March 1, by April 1 society was halted. This is worse.

Its a reasonable opinion to hold people working on such breakneck AI progress to the standard we would hold if your friend told you they were making a nuclear warhead in their basement. It should be stopped.

I'd really love to call this end-times millenarianism with no factual basis, but Kokotajlo et al. have had a much better track record at making predictions than I am, and I've always underestimated the rate of AI progress. This is much both much more reasonable and much more terrifying than I'd like to admit.

Seems like this should be bigger news. But maybe that’s a sign that HN doesn’t buy these scenarios. What is it?