3 pointsby Mnexium23 minutes ago1 comment
  • late_night_fix10 minutes ago
    I try to batch requests and reuse responses wherever possible.LLM API calls are awesome,but if you don't watch your usage,cost sneaks up fast.
    • Mnexium2 minutes ago
      Agreed, are you doing anything to take advantage of cacheing?

      Anything else you can share about project?