3 pointsby GodelNumbering5 hours ago1 comment
  • Leynos5 hours ago
    Is this using the server side compaction of the responses API?
    • GodelNumbering5 hours ago
      No, server-side compaction is inherently tied to the model's current context. This uses a full side prompt to get the compaction result, then swap the context with new compaction result. I did a bunch of tests and the results from Luna were indistinguishable from Sol