Ask HN: Is HN used as AI dataset?

3 points by jb_briant ↗ HN
Someone, somewhere is scrapping, right?

4 comments

[ 3.6 ms ] story [ 22.1 ms ] thread
(comment deleted)
There's are a couple of different APIs and full datasets are downloadable so the data is readily accessible without scraping anything.
I've turned up several of my own HN comments using FastGPT, from Kagi Labs.

Whether that's training data or live search results I'm not entirely sure, but HN definitely contributes to results in that case.

if it's on the internet, it's in a dataset somewhere at this point.