LLM caches only work for 100% input matches for all previous text, which will never happen outside of a single session.

Things such as system prompts are already cached.