HN Explorer

17 comments

[ 5.0 ms ] story [ 60.3 ms ] thread
aidanf
If you want to play around with data, here's another good list of open/free datasets: http://bitly.com/bundles/hmason/1
supo
Nice, thanks! I wish there was a cleaned up repository of datasets like these, in a unified format, directly accessible to a public MapReduce engine like Elastic at AWS.
PaulHoule
no links...

Remember the days when people used to make links on the web because they weren't greedy with their pagerank?

At least Google left us some machine learning data sets after they took all the links. You just can't find them because nobody links to them.

supo
I'm sorry for not making it more obvious, but each bullet point in the list ends with a link.
option_greek
Is there any data set that embodies human relationships with every day objects ?
chatman
Where is the Web1T dataset? Would you not consider it useful for Machine Learning?
cardine
I think this list only includes free datasets.
ChikkaChiChi
Fantastic links throughout this thread.

When playing with new programming languages instead of a 'todo' list I always end up building an XKCD password generator. Interestingly enough, I've never found a frequency/comprehension list worth using to populate it for public consumption.

X4
BitTorrent Please! Why does it cost so much? They grabbed our data for free and they have enough free Bandwidth. Let's assume they are greedy, then they could at least offer it through BitTorrent. DVD's for that amount of data is ridiculous. I don't even have a DVD-Reader…

Can't afford buying all that + shipping to Europe, but would like to play with the Data for my NLP Project.

skun
I agree ! I too can't afford it but would really love to play around with that data because i'm just beginning to learn about NLP and stuff. I too feel that shouldn't have been priced and not in a DVD!
thangalin
http://bitly.com/bundles/hmason/1

http://commondatastorage.googleapis.com/books/icdar2007/READ...

http://datahub.io/

http://blog.bigml.com/2013/02/28/data-data-data-thousands-of...

http://iatiregistry.org/

http://open.undp.org/

http://data.worldbank.org/

https://explore.data.gov/catalog/raw/

http://www.data.gov/opendatasites

http://data.gov.be/datasets

http://opencorporates.com/

http://glasspockets.org/work/reportingcommitment/api.html

http://thedata.harvard.edu/dvn/

http://www.reddit.com/r/datasets

http://archive.ics.uci.edu/ml/

http://cleandatahub.org/

http://datacatalogs.org/

http://archive.org/details/oxford-2005-facebook-matrix