"What is a Language Processing Unit (LPU)?":
https://groq.com/blog/the-groq-lpu-explained
>"Groq on-chip SRAM has memory bandwidth upwards of
80 terabytes/second
, while GPU off-chip HBM clocks in at about eight terabytes/second. That difference alone gives LPUs up to a 10X speed advantage, on top of the boost LPUs get from not having to go back and forth to a separate memory chip to retrieve data."