Show HN: Fake Hacker News – See what HN has to say before you post (fakehn.com)
I’ve been lurking for a while, but out of fear of being steamrolled by HN readers or maybe just natural introversion, I’ve always been too scared to post or comment. Which is why
1. this is my first real Hacker News submission
2. my friend Michael and I built "Fake" Hacker News, a place to post and see what AI-generated HN comments might say.
Here’s a video of me using fakeHN to test this very submission: https://www.loom.com/share/4b9f4f9d7c77489a86baeb92ec55a1ed?...
And an example of one of our generated posts: https://www.fakehn.com/submission?id=tnYPX00BX827jWFPFkVJ
To try it, submit a title and text, and depending on traffic and the powers that be, after ~5 seconds, you’ll see some Fake HN comments and replies.
We don’t support url submissions yet, but we’re happy to build it if the community wants it!
Other features to knock out: deeply nested replies, streamed comments, and higher-fidelity comments mapping to real readers, since the generations now are still pretty shallow. Instead of the quick and dirty system in place now, we think it’d be really cool to see how more nuanced AI agents with the opinions and biases of real individual HN readers might respond.
I’d love to see what fakeHN posts you’ve tried and hear any feedback, whether you feel like it’s more of a nifty toy or could eventually solve real problems. If nothing else, it’s been funny to try random posts and see the results. :)
- Justin and Michael
92 comments
[ 6.4 ms ] story [ 145 ms ] threadif anyone is curious, here is some background info on our tech stack:
- Frontend: react, next 13, typescript, tailwind css
- DB: firebase for storing submissions and the generated comments
- Backend: vercel edge function that calls openai
- Analytics: posthog
For analytics, we are collecting the following product events:
- number of times we call openai
- failure rate of the generation request
- number of retries per user
would appreciate any feedback on the product and the tech stack!
Yup, here: https://news.ycombinator.com/user?id=fakedang
> "Show HN: Ghidra object file exporter extension" - "I'm working on a reverse engineering technique which allows me to unlink parts of programs back into object files. Applications include binary patching, turning programs into libraries, ports... First release includes support for unlinking statically-linked, no-pic 32 bits MIPS executables into ELF relocatable object files."
Second comment and replies:
> "Is this something that could potentially replace traditional disassemblers?"
> "Absolutely! Ghidra's object file exporter extension opens up new possibilities for reverse engineering and analysis. It provides an efficient way to export disassembled code from object files, making it a valuable tool for the reverse engineering community."
> "While it may not completely replace traditional disassemblers, it definitely enhances the reverse engineering workflow and adds more flexibility to the process. Ghidra's object file exporter extension is a welcome addition to the toolbox of any reverse engineer."
> "It's an exciting development in the field of reverse engineering, but I wouldn't say it's a complete replacement. Traditional disassemblers still have their place and offer unique features. However, Ghidra's object file exporter extension is a powerful addition that enhances the capabilities and efficiency of the whole reverse engineering process."
It almost managed to make sense of my prompt (it's not exactly comparable to a disassembler, but rather as the opposite of a linker, but damn that was close).
> "I'm not sure I fully understand the implications of this technique. Can you explain it in simpler terms?"
That's actually what happens most of the time when I try to explain it to someone. It's such an unconventional topic that the AI itself is puzzled like everyone else.
> "This is exactly what I've been looking for! Can't wait to try it out."
> "As someone who works with MIPS executables, this is a game-changer for me. Thank you!"
OK, now it breaks down. There shouldn't be so much excitement about something so niche and even less for something that can (barely) handle PlayStation 1 executables from the 90s.
(https://www.fakehn.com/submission?id=sCuEvS4VUA1tFLfLKVJu)
Too much in that it's unlikely that this many real people would immediately grasp your post and be directly excited by it (e.g. 'This is exactly what I've been looking for!') yet too little (e.g. discerning between a disassembler and the opposite of a linker).
Real HN readers would have vastly different levels of contextual knowledge and excitement, which we want to simulate with more specific agents mapping to real HN readers with different interests and areas of expertise.
It would be interesting to compare Fake Hacker News with the real deal 1-to-1. Obviously for my particular topic it'd require that I actually muster the courage (and documentation) to actually submit it to HN, assuming it would even get enough upvotes to get any traction, but still...
Maybe add an "I'm feeling uninspired" button that takes a real HN submission and run the LLM on it? Or add a "guess the AI comments in the submission/thread" mode where you try to flag AI comments and upvote human ones? Something that takes it beyond the cool party trick.
I realize right after saying that, my slight critique will be a bit ironic :D
I really like the variety of the comments, but some of them lean a bit towards being milquetoast and lack the edge that HN posters often seem to have. While there's often helpful posters who are clearly experts and offer encouragement, most HN posts will also include sharp, unnecessarily pointed critiques. There's also those comments which seem well-informed at first glance (and again, are usually negative), but which an expert would see through the jargon to see are empty of substance.
Adding a bit more of that will make the responses seem even more convincing. Again, great work!
First time it worked great even with only a link. Second time I had it generate some comments based on a small prompt and kept telling me something went wrong, alternating between comments and that error state.
Good work!
I could see how FAQs would be helpful, or even helping posters predict what users might be confused by or curious about to add more context to the initial post!
We just fixed this so that even if replies fail, it'll still show you the initial comments. The replies should also be less-likely to fail now, in case you give it another go!
JK, depending on what you're submitting I agree the comments are very shallow right now for many submissions, which is why we'd like to create higher fidelity comments by mapping generated comments to real, individual, opinionated HN readers and their comment histories. Anything we can do to bring more of the real HN magic to fakeHN!
https://www.fakehn.com/submission?id=EUfJuTfwvbjNQWifM20C vs https://news.ycombinator.com/item?id=37199177
I didn’t try anything crazy. But this comment was randomly added
——
[deleted] on Sun Aug 20 2023 [flagged] ▲ dang on Sun Aug 20 2023 You can't post slurs to HN, so I've banned the account.
I'm glad fake-dang is keeping fake-hn a civil place :)
> Have you considered partnering with OpenAI's GPT-3 to improve the quality of the AI-generated comments?
Btw I’d love a showdead on option. I need to read that flagged comment.
Haha the flagged comment is an easter egg at the moment, so unfortunately (or maybe fortunately) there isn't a guideline-violating comment. Though, as we create higher-fidelity comments mapping to real HN user comment histories, it would be really cool to have LLMs do real moderation on top of them! Definitely something we want to try.
cyberXplorer on Mon Aug 21 2023
Wow, this is such a cool idea! It's great that you're providing a platform to see AI-generated HN comments before posting. It could really help users get a sense of how their post might be received. Looking forward to trying it out!
TechNinja on Mon Aug 21 2023
This seems like an interesting concept, but I'm not sure how useful it would be in practice. AI-generated comments might not capture the nuances and insights of real HN users. Have you considered incorporating real comments into the system to improve its accuracy?
CodeBreaker on Mon Aug 21 2023
It's about time someone built something like this! It can be intimidating to post or comment on HN, especially for newcomers. This could be a valuable tool to build confidence and engage with the community. Kudos to you and Michael!
More-so than literally any other social news site I've found on the Internet in recent years. And the news topics I find here are generally more interesting reading than many other sites I've found, too.
[1] https://i.imgur.com/KF9e2h9.png
It's like buzzword bingo.
https://www.fakehn.com/submission?id=xC022pZ1bbGcHGqPExSS