HN Explorer

Ask HN: What are the funnest data sets you’ve played with?

28 points by hnthrowaway1099 ↗ HN
Trying to battle test our startup product to help users prepare data for data science, looking for some interesting data sets to play with. Ideally something publically downloadable, non controversial and under 1 GB.

10 comments

[ 0.19 ms ] story [ 354 ms ] thread
giraffe_lady
Destiny 2 has an api that a lot of great third-party organizational tools are built around. But you can also download a sqlite file with all the set game info in it: weapons, abilities, perks, items, upgrades etc. I haven't messed with it in a while but I remember it being pretty small, one or two hundred mb.

It's highly normalized, to the point where it goes backwards and starts to actually interfere with human usability. Not sure if that helps your goal or hinders it. I used to use it for teaching both sql and the pros/cons/usefulness of the normal forms.

vital_beach
Wahpedia has a pretty unusual Warhammer 40k dataset

general overview: https://wahapedia.ru/wh40k9ed/the-rules/data-export/

spreadsheet with dataset links: https://wahapedia.ru/wh40k9ed/Export%20Data%20Specs.xlsx

neerd
Damn, I wish I’d known this existed. I ended up building a parser for the raw battle-scribe xml files
vital_beach
that's honestly a better route. battlescribe has more data, but the schema is a nightmare and gives me headaches.
mhh__
Not super exciting but tire data# is both hard to model and very expensive.

# Data from spinning a tire while crushing it into a "road" at an angle

chunkyks
Early in covid, I played with a famous 65-year-venerated dataset from where I work. Found some interesting minutiae and ended up on the front page of the wsj over it.

https://github.com/RANDCorporation/milliondigits

It's probably not what you're looking for, but it's my own favorite dataset.