Hacker News
new
top
best
ask
show
job
768GB Intel Optane DIMMs to run 1T-parameter LLM with single GPU at 4tps
(
www.tomshardware.com
)
25 points
by
walterbell
8 hours ago
2 comments
musicale
2 hours ago
Ah Optane, what might have been...
Even over PCIe, I imagine the advantage vs. NVMe is lower latency and more operations per second.
lostmsu
3 hours ago
The bottleneck in this setup is PCIe bus. You don't need optane to saturate it. 4 regular SSDs might do just fine.