Don't make Naked LLM calls. Protect your users and their data(medium.com)
6 pointsby dwa35927 months ago3 comments
  • 7 months ago
    undefined
  • droobytrain7 months ago
    Looks cool. What kind of delay would it add to a chatbot application?
    • dwa35927 months ago
      Author here. I need to calculate the timing delay but I don't feel any difference in speed in my local chatbot app, where every prompt is filtered. I am on Mac M3, 16GB.
  • lexiciccone7 months ago
    [dead]