Hacker News
new
top
best
ask
show
job
Ask HN: What are the machine requirements for a LLM like Llama-3.1-8B?
2 points
by
wasimsk
4 hours ago
2 comments
yorwba
2 hours ago
https://www.canirun.ai
can help you find a model that'll run on your hardware.
alex7o
3 hours ago
Think of it like that 8b model needs 8gb of vram. Also search online there is a lot of info on that