Echo cancellation for real-time output is a nasty problem. I hit similar walls with a browser-based take on this (livesuggest.ai) — you get easier distribution but lose a lot of control compared to native. The Founders real-time suggestions piece is what I'd want to try most. What's the end-to-end latency like in practice?