1 comment

[ 2.7 ms ] story [ 8.9 ms ] thread
I wonder why they didn't use a in-memory store for deduping. Using something like a bloom-filter could solve their problem it seems.