for search over 12k skills, it takes around 150ms to 1 sec. Depending on how broad your query is.

For the security nightmare I have taken precautions, and by default only skills from trusted repos are given.

They could potentially websearch and find new skills, but that is tough, and of course will not be able to reach niche skills, that would be perfect for your use case. I have created semantic search with a ranking algorithm to give the appropriate skill in an instant.

I have indexed skills from trusted repos and github. And giving semantic search for the agent, along with ranking based on stars, forks, installs etc. Trying to create a flywheel loop as well, where agents can rate skills and that gets incorporated in the ranking.