HN Explorer

Ask HN: Training a model on all HN data?

3 points by tmaly ↗ HN
I just had a thought, maybe dang could chime in. Has anyone considered training a model or fine tuning a model on all of hacker news discussions?

4 comments

[ 2.6 ms ] story [ 13.1 ms ] thread
minimaxir
It's relatively straightforward to download all HN submissions/comments via BigQuery and then finetune an LLM, there's just not much point to it.

You can safely assume all modern LLMs have been trained in part on HN data.

anigbrowl
HN was part of the training set for ChatGPT. But it might be interesting to train/fine tune on HN alone. You could weight by karma or conversely you might identify shortcomings in the karma system.
minimaxir
Comment vote data is not public, which is the data you would need to make such a system useful.