2 pointsby FrancescoMassaan hour ago2 comments
  • FrancescoMassaan hour ago
    We have a new update for brick : with feedbacks from users we inserted context caching aware routing. so that savings are improved even if switching models transfers context from one kv cache to another. we introduced a tier1 compaction algorythm that makes the router cheaper while mantaining performances. Try it out with brick claude settings > cache aware routing > smartsqueeze
  • Jimmy0252an hour ago
    [dead]