If the resellers cache results, how it is done? I am aware it's possible with a KV cache, but those resellers do not have access to Claude's KV memory?
If they do not cache results, how does this work?
My personal guess is some of those "providers" use inputs/outputs for training "open"weight models.