1 comment

[ 4.3 ms ] story [ 37.2 ms ] thread
I wonder why they didn't use a in-memory store for deduping. Using something like a bloom-filter could solve their problem it seems.