OP: Hackernews offers an excellent API via Firebase: https://github.com/HackerNews/API. Unfortunately, their fetch method doesn't offer any way to filter by item types. So collecting all posts take excessively long thanks to all the comments.
Based on the official item API, this focuses only on the main posts with at least 2 engagements. The posts in datasets are about 1.5% of the items returned
With posts as a starting point, you can easily trace the hierarchy from "kids" fields.
Potential Usage:
- Generate popular titles.
- Collect comments in a hierarchical order for further training.
- Analyze popular topics in the engineering community.
- Identify the best time to post for maximum engagement.
5 comments
[ 4.4 ms ] story [ 24.1 ms ] threadBased on the official item API, this focuses only on the main posts with at least 2 engagements. The posts in datasets are about 1.5% of the items returned
With posts as a starting point, you can easily trace the hierarchy from "kids" fields.
Potential Usage:
- Generate popular titles.
- Collect comments in a hierarchical order for further training.
- Analyze popular topics in the engineering community.
- Identify the best time to post for maximum engagement.
So it's great for blog spam.
GPT-3 would produce comments that would get up voted but contribute absolutely nothing.
You'd be better crowdsourcing your idea with a page to point people to explaining how the threads been done before and the common answers.
But here is a outed Reddit user -
https://www.theregister.com/2020/10/09/reddit_gpt3_bot/
https://www.reddit.com/user/thegentlemetre/