3 pointsby xiaoxumz115 hours ago1 comment
  • JPLeRouzic2 hours ago
    Do they cache results so users can receive already generated answers?

    If the resellers cache results, how it is done? I am aware it's possible with a KV cache, but those resellers do not have access to Claude's KV memory?

    If they do not cache results, how does this work?

    • Good4boothee2 hours ago
      Check previous discussion: https://news.ycombinator.com/item?id=49058993

      My personal guess is some of those "providers" use inputs/outputs for training "open"weight models.

    • iwontberude2 hours ago
      Nope, it’s just simple arbitrage. All of the subscription tiers offer 5-10x better prices than metered api fees. They use subscription to hook people and get them desperate enough to pay for ad-hoc generation outside of their subscription to make a profit. The economics of Claude do not work unless a significant % of subscribers convert to standard metered API use. They are trying any trick under the sun to make this happen.