$100k?!?! Damn, what were you doing with all of those tokens?
I reposted this here since it's not getting enough attention here: https://outspeaker.com/post/8
Technology companies are adding a fourth component to engineering compensation : salary, bonus, options, & inference costs. Levels.fyi pegs the 75th percentile software engineer salary at $375k. Add $100k in inference & the fully loaded cost is $475k. That’s 21% in tokens.