Hacker News
new
top
best
ask
show
job
Should I reconsider my decision of self-hosting LLM Gateway?
1 point
by
leanroute_ai
8 hours ago
2 comments
FatalLogic
7 hours ago
Isn't this a general class of problem that has a similar risk profile for any type of gateway that accepts inputs that are not very tightly bounded?
Not only LLM services.
verdverm
4 hours ago
I'm running a gateway for my local LLMs, are you opening it to the internet? Who's going to craft a malicious payload?