EdgeSync-LLM – KV cache fragment engine for on-device LLM inference (Go/Android)(github.com)
2 pointsby bossandboss2 hours ago1 comment