HN Explorer

6 comments

[ 5.1 ms ] story [ 28.8 ms ] thread
DrSprout
I hope they do elect to store the actual URLs when URL shorteners are involved. Really, though it would eat a hole in the URL shorteners' business, I really think sites like Twitter should be dynamically 'fixing' those links before inserting them into the database.
astine
For those interested, I asked around and it looks like the entire Twitter collection is only going to be 5TB worth.
[deleted]
(comment deleted)
ErrantX
I calculate the tweets data must be around 3.5TB so that figure seems about right (if you throw in user and times tamp data)
sjs382
I've been curious. Does this include the tweets of "private" accounts?
clistctrl
The article mentioned that only public accounts would be included.