Discussion – has anyone build a firewall for AI models yet?
3 pointsby Akhiljp7 hours ago2 comments
  • KynaraAI7 hours ago
    I am not a firewall or security expert but would you have organizations protect their sensitive data from AI's reach thereby limiting AI's ability ? Wouldn't the real ROI of AI will depend on the sensitive data ?

    I guess dynamic firewall's with runtime permissions are needed protect the data and at the same time let AI do it's thing.

    • Akhiljp7 hours ago
      I beg to differ - manipulating a model to extract data is worse that protecting sensitive data. I am curious as to why this is not a big space yet?
      • verdverm7 hours ago
        We already have many components and solutions for "firewalls", like everything we've done with microservice isolation. If you mean "sandbox" more than "firewall", there are 100s since Claude Code came out
        • Akhiljp7 hours ago
          So my first thesis that I want to prove is - are all enterprises going to start self hosting open source models ? If yes, then one will need to deploy a solution around the models to act as a firewall. A firewall fine tuned for the context that’s coming in and coming out of a model. Way different from how microservices work today.
          • 6 hours ago
            undefined
          • verdverm6 hours ago
            1. Most enterprises are not self hosting at this point, hardware is too expensive. We want model choice. Eg. we are buying Fireworks.ai, however this is irrelevant to point 2

            2. "firewall" is the wrong term, you are looking for "guardrails" if you are talking about prompt protections. Here again, there are 100s of projects and takes on this. Ai is the hottest space right now, people are thinking about all of these things. This piece is central to Fable access being shut off.

            • Akhiljp6 hours ago
              Ack on the guardrail analogy. On fireworks - do you just run serverless or do you take their dedicated instance. My question is how do you ensure that the model is not being manipulated to getting stuff it shouldn’t be.
              • verdverm6 hours ago
                "guardrail" is not an analogy, it is the term used in industry, you can search "ai guardrails" or "agent guardrails"
                • Akhiljp6 hours ago
                  My bad. Wasn’t aware. Thank you.

                  Looking forward to understanding the second part of this.

                  In fireworks - how does one build guardrails or it does not matter to companies hosting their models on fireworks?

  • pagutierrezn6 hours ago
    When you say firewalls for AI models, you mean firewalls for agents, right? Otherwise, I don't see the need to firewall a model.
    • Akhiljp6 hours ago
      I meant for a model. Like agents could be many within an organization, instead of patching up each agent with a security solution, wouldn’t it be easier to build one that wraps around the model ?