Ask HN: What are the best key-value self-hosted storage engines?
It could be a full db or a file-based binary.
Interested in being: - simple - thread safe - fast - supporting lots of records - querying features is a plus
Interested in being: - simple - thread safe - fast - supporting lots of records - querying features is a plus
13 comments
[ 1.8 ms ] story [ 30.0 ms ] threadhttps://mapdb.org/
It is more feature rich than you want but in Python I'd probably just use sqlite3 since it is in the standard library.
Some folks claim 200k inserts a second, but we topped out at around 20k inserts a second and had to start digging into more advanced configurations and whatnot. Eventually we sharded and sent some requests to one pool of redis and other requests to a different pool based on consistent hashing that we set up. But even then, I don't think most shops need to worry about that scale.
I'm not saying everyone should only use those two I'm just guessing there's more to the criteria you have in mind than you wrote here.
Pros: Extremely fast. https://github.com/ohsayan/sky-benches
Cons: Still early in development, not a ton of features.