Search logs faster than Sonic – Log search engine internals (blog.vegasecurity.com)

Learn about the data structures & algorithms that make up modern log search engines like Elasticsearch.

Seems super cool.

I just ran ripgrep on a few million logs and was amazed at how fast it was. Fascinating read!

Great breakdown of data structures like Tries, FSTs, and DAWGs for log search! How do these compare in terms of memory usage and update performance? Awesome read!

Log formatting is probably most important than figuring out how to search logs.

Grep has worked well for me so far