New Obsidian Search Plugin: Combines Fzf, Telescope, OmniSearch and Embeddings(www.ssp.sh)
3 pointsby zazuke6 hours ago1 comment
  • exceptione5 hours ago
    So what figure exactly is tested for 10k+? Is it 12k, 100k or more like 1m? I couldn't find.
    • zazuke5 hours ago
      The "exact" tests were made with 12k notes in my test vault and 10k in my personal vault. I haven't tested for 100k, but it would be interesting, do you have a vault or example of such a vault?
      • exceptione5 hours ago
        I know people hit the 10K really fast. 10K is the limit for which obsidian switches algorithms (personally, I don't understand how 10K db rows would be a problem, but ok). It is very easy to run into 100k:

        - external sources like the documentation for your programming languages, frameworks etc that come as markdown

        - if you store every entity as a note, like you do with obsidian bases. Think task tracking, habit trackers, book collections

        - clippings, daily notes, project notes, zettels etc

        So if I would design a search improvement, I would test the 100k, 200k, 500k, 1m mark with synthetic data.

        • zazuke2 hours ago
          yeah good point, I will add more docs and try that, and I doubt it will have any problems.
    • zazuke5 hours ago
      it should be doing fine on any size, but I noticed OmniSearch hits limits around 10k notes for me, you could also use it way before and way over. But I guess if you have fewer than 4k, you might not need sophisticated search, except if you enjoy the added features such as preview and searching by title, headers, and semantics.