A few days ago Sam Altman was on Stripe’s Cheeky Pint podcast talking about the memory shortage. On people running models locally he said:

"It’s quite terrible to have everybody have a bunch of the world’s limited supply of DRAM sitting in their own computer. And be used 5% of the time."

I’ve been running models on my own machine for a few months now so I wanted to see what my numbers actually look like.