I'm curious about the "don't use vector search" suggestion. I've done this recently for tool discovery in my own tool service, and it seems to work well, but obviously I'd like to know why that was a bad idea.
Agree. I think it is a little reductive. Regex / free text search can obviously miss things (as can vector stores). Combining both of them is fairly typical (along with a re-ranker, potentially). You are basically trading quality for latency and cost.