The "exact" tests were made with 12k notes in my test vault and 10k in my personal vault. I haven't tested for 100k, but it would be interesting, do you have a vault or example of such a vault?
I know people hit the 10K really fast. 10K is the limit for which obsidian switches algorithms (personally, I don't understand how 10K db rows would be a problem, but ok).
It is very easy to run into 100k:
- external sources like the documentation for your programming languages, frameworks etc that come as markdown
- if you store every entity as a note, like you do with obsidian bases. Think task tracking, habit trackers, book collections
Tested it on 100k notes, the fast find plugin works quite well. a bit slower, instead of a 3ms search result on a 10k vault, it takes up to 300ms in some cases. Indexing was fine, but Obsidian's own index took forever to finalize, and the whole Obsidian app was not really made for such big vaults. But my plugin seems to be fine :)
5 comments
[ 0.27 ms ] story [ 2.7 ms ] thread- external sources like the documentation for your programming languages, frameworks etc that come as markdown
- if you store every entity as a note, like you do with obsidian bases. Think task tracking, habit trackers, book collections
- clippings, daily notes, project notes, zettels etc
So if I would design a search improvement, I would test the 100k, 200k, 500k, 1m mark with synthetic data.