10 comments

[ 5.2 ms ] story [ 42.4 ms ] thread
Writing to disk for every write is required, otherwise you're not durable.

Sure it's faster to never write to disk, then you reboot and you've lost data.

/dev/null is a webscale database that is even faster!

> A 100-bit bloom filter holding 100,000 keys is saturated instantly. Every bit is set. It returns “maybe present” for every key you ask about — which means it filters nothing, and every read falls through to a full file scan.

Hahaha. (Seems like the bloom filter library isn't set for maximum false positive rate and/or to autoexpand.)

Edit: Actually there's a BloomFalsePositive setting, maybe it never gets used? Also maybe it's not a library and it's a custom implementation.

Your right should go into a queue and get compacted later on?

That's what Cassandra does iirc

> A 100-bit bloom filter holding 100,000 keys is saturated instantly

> This is the kind of bug you only find by building the thing and measuring it.

No? I mean, maybe if you're vibecoding it's the only way, but in the prehistoric days you could reason about what code would do before you ran it.

Yeah, especially a bloomfilter which has a pretty easy formula for its false positive rate.
i don't know why you're trying to analyze the meaningfulness of sentences that are not the results of a human thought process but are clearly rhetorical flourishes from an llm that "feels" compelled to fill its prose with them
Isn't this what units tests are for?
> A few weeks ago I wanted to understand how the storage engine inside RocksDB actually works. Not read about it. Build it.

Immediate tell that this was written by AI. Another thing I've noticed lately - AI's overuse of "every":

> Every batch of writes called `file.Write` on the write-ahead log.

> Every read was scanning entire SSTable files.

> Every bit is set.

> Every value matches.