As for the token costs, have you looked at Gemini 3.1 Flash-Lite (preview)? The quality is solid and it's dirt cheap: $0.25 per 1M input and $1.50 per 1M output. Unless you have massive traffic, it would probably only cost a few dollars a month. Seems like a very reasonable overhead for the value it adds