HN Explorer

21 comments

[ 3.4 ms ] story [ 47.0 ms ] thread
neogoose
I have open sourced the fastest code search implementation. Comprehensive SDK for both file finder and grep file search that is over 100x faster than ripgrep
jcgrillo
k, but what actually are you talking about?
kristopolous
I ran across this fascinating tool a few days ago researching embedding models on hugging face.

Advertised as "ColGREP Semantic code search for your terminal and your coding agents",

I haven't put it in any harness yet but I probably should.

https://github.com/lightonai/next-plaid/tree/main/colgrep

I've also tried astgrep (also known as sg) but llms really mess up on them. I think you'd need to fine tune.

If anyone has cracked that case I'd love to hear about it

schrodinger
How's it work? Embed tokens and use euclidean distance or something?
globular-toast
Why is it "for neovim"? Surely such a thing would be useful in many applications?
genewitch
considering that ripgrep has marginal overhead over just reading the files to /dev/null, how exactly does this achieve 100x speedup?

I have a lot of use for something that can search ~1GB of text "instantly", but so far nothing beats rg/ag after the data has been moved into RAM.

Yokohiii
The crate says it uses SIMD, but the crate also says that content search is 20-50 times faster. Maybe the guy unsure how fast it is or how much speedup he should claim to get recognition.
neogoose
you can try it yourself. ripgrep search for "MAX_FILE_SIZE" in the chromium repo takes 6-7 seconds, with fff it is 20milliseconds

so essentially in this specific case it is over 1000x faster, but the repo size is huge (66G, 500k files)

asdfadsfaf
I don't get it how can I search anything but the file name?
dig1
ctags, GNU Global and even "ugrep -Q" would like to have a few words with you ;)
swiftcoder
Is there a write up of the underlying approach? The summary on the repo mentioned SIMD, but not a whole lot else.
pjmlp
It has never been ripgrep for decades for those of us on IDEs.
forrestthewoods
Websites that don’t tell me what they’re doing are infuriating. I’m on mobile. This landing page experience is awful.
wiseowise
The future is lack of scrolling on mobile, and scanning getting stuck, apparently.
hugodan
Why do all vibecoded sites look the same? Same black on neon vibes and button styles
self_awareness
I've entered "bazel" and got `shellPrefix.ts` which doesn't relate to bazel in any way.

If that's the future then I'll stay in the past with ripgrep.

CodesInChaos
Where can I find the benchmark for the "20-50 times faster than ripgrep" claim from the documentation, or the "100x faster" claim from the HN submission title?

Ripgrep already has optimizations for regex which don't contain any patterns (or even just regex which contain such substrings). So "not regex" shouldn't be what makes the difference.

austinjp
To save people the digging, here's the git repo:

https://github.com/dmtrKovalenko/fff.nvim

"FFF stands for freakin fast fuzzy file finder (pick 3) and it is an opinionated fuzzy file picker for your AI agent and Neovim. Just for file search, but we do the file search really fff well.

FFF is a tool for grepping, fuzzy file matching, globbing, and multigrepping with a strong focus on performance and useful search results. For humans - provides an unbelievable typo-resistant experience, for AI agents - implements the fastest file search with additional free memory suggesting the best search results based on various factors like frecency, git status, file size, definition matches, and more."