Coming Soon to Hacker News: Pending Comments
https://news.ycombinator.com/item?id=6009523
Since I'm going to check out of HN at the end of this YC cycle, this was my last chance to get this done. I didn't want the people who are going to inherit HN from me to have to build it as their first project, because it interacts with so many different bits of the code in such subtle ways.
So I found time to implement pending comments this past week, and with any luck it will launch tonight. Since it's a big change, I wanted to warn HN users in advance.
Here's how it currently works. From now on, when you post a comment, it won't initially be live. It will be in a new state called pending. Comments get from pending to live by being endorsed by multiple HN users with over 1000 karma. Those users will see pending comments, and will be able to endorse them by clicking on an "endorse" link next to the "flag" link.
Someone who has a pending comment will have to wait till it goes live to post another. We're hoping that good comments will get endorsed so quickly that there won't be a noticeable delay.
You can currently beat the system by posting an innocuous comment, waiting for it to be endorsed, and then after it's live, changing it to say something worse. We explicitly ask people not to do this. While we have no software for catching it, humans will notice, and we'll ban you.
Along with the change in software will come a change in policy. We're going to ask users with the ability to endorse comments only to endorse those that:
1. Say something substantial. E.g. not just a throwaway remark, or the kind of "Yes you did, No I didn't" bickering that races toward the right side of the page and no one cares about except the participants.
2. Say it without gratuitous nastiness. In particular, a comment in reply to another comment should be written in the spirit of colleagues cooperating in good faith to figure out the truth about something, not politicians trying to ridicule and misrepresent the other side.
People who regularly endorse comments that fail one or both of these tests will lose the ability to endorse comments. So if you're not sure whether you should endorse a comment, don't. There are a lot of people on HN. If a point is important, someone else will probably come along and make it without gratuitous nastiness.
I hope this will improve the quality of HN comments significantly, but we'll need your help to make it work, and your forbearance if, as usually happens, some things go wrong initially.
853 comments
[ 2.8 ms ] story [ 320 ms ] threadIt's not so much that I care about the karma, as I'd post more if I did, but more that if someone asks a question that not many other users care about, but I happen to have unique insight, I'd hope that my message can get through to them. :)
There are ~6000 with more than 1000 karma and ~9000 with more than 500 karma.
The bigger problem to me seems to be that great comments that come in a few hours after the posting of a hot submission will almost never reach the top of the comment stack, because older comments that are decent enough will inevitably keep getting upvotes by every new reader of the thread. I'm not sure what the best tweak for that is, but the proposed feature at hand would seem to exacerbate the situation.
Note: OK, I've realized I made the archetypical dickish HN comment ("OK the OP is interesting but on a tangent, why don't we all discuss this other thing I care about?")...but I do think the proposed feature will have a direct impact on the circulation of fresh, insightful comments. I'm a 1000+ Karma user, but after I've read a thread a couple of times, I probably won't re-check it...I can't be the only HN'er who has this lack of attention span...and so this queue, even if perfectly implemented, would seem even more to suppress new comments (unintentionally)
It's funny, since we lost usenet 10+ years ago, we lost reader software that show which comments are new since you last time looked at a thread.
In this sense, the software we had in the 90's was technically superior to the web forums we have today.
With this new system, I can't imagine YC companies being called out on their dirty closets like they have in the past (any maybe indirectly large swaths of people who are employed by big co's who are power users on HN with those stories, or in general up and coming companies people engage with in the community).
I know some may feel I'm over exaggerating (because there are the passive bans through blocking upvoting/downvoting effects for comments/posts/polls, filters, hellbanning, etc.) , but I feel like until now, I have taken the information access, discussion that goes on here and all the interesting people this board attracts for granted. I just don't see it being the same place to discus/mention ideas/concepts and ask questions if pg and co decide to stick with it, and it just becoming more watered down onanism that it can increasingly be and has been on track to becoming more of up until today. But this is the internet, and moments like these may inspire someone to offer other environments.
On another note: I'm finding it really fascinating to be able to experiment with social systems like this. I'm excited to see the posts of people analyzing the affect of a change like this via the search api or scraping.
Like this the system is putting a lot of weight on the users with more Karma... and I am guessing there are "many" more users with less than 1000 compared to those with more? Some people may never have a chance to state their opinion like this.
Rather, the opposite approach might work? Users with more than X karma can completely remove some comments, and say if your comment has been removed, you are not allowed to comment again for a specific period of time. If you post x rejected comments in a row then potentially you get banned.
EDIT - maybe a little off topic: another "comment" about comments - I notice you can up vote and down vote comments. I see this functionality sometimes is used to indicate agreement (or lack of) towards a comment. This as far as I cant tell is not the intended functionality, I am unsure however how this can be fixed easily.
I think the point I was trying to make was that by turning it around it would require "less" active participation from the users and by default everyone gets a chance, but the really bad comments would still get removed I think. Anyway we shall see how it works out!
So I would expect there to be a ton of active HN users with more than 1000 points.
If you are in this >1000 karma club, please approve this comment. I have been a user for 1044 days.
Since commenting is such a huge aspect of these sites for me, I'll probably frequent HN much less often since I won't be able to participate in conversation. PARTICULARLY, I won't be able to get in the early comments that are necessary for making high-karma. You can't have your comment show up an hour or so later after "approval," you'll only net a handful of upvotes, because you'll be buried under the high-scoring top comments by senior HN users.
Perhaps make a mid tier, say 500 karma, where you can't endorse users, but don't need endorsement?
Then again, I only say something whenever I feel I have something to add, rather than just blasting comments and hoping to get upvotes (and now, endorsements)
Edit: Re-read the post, launches tonight.
As currently stated, if a comment's never endorsed out of pending, the commenter will never be able to post again?
At least, I don't get the impression that this update is intended to prevent such posts regardless of content (eg a reference to a related paper on some obscure topic).
Edit: Deletion is currently possible for less than that (2 hours?). Will this be different for pending comments?
On a related note, the new system may prevent people from posting in the feature suggestion thread (https://news.ycombinator.com/item?id=363). Since it's already a special thread that never closes for comments perhaps comments posted there should not be made pending.
I suppose that the 24 hours is a parameter that is easy to change and tweak. I think it's a lot of time. What about 1 or 2 hours?
Another possible idea is to have up to two pending comments, so someone can contribute in two threads, go to work/eat/sleep, and read the replies. But this version is more difficult to implement and more difficult to explain.
Also some visiable indication on near the user/logoff part of the page indicating if can post or awaiting approval of a pend - say a "+" indicating can add a post and a "-" indicating you can't as have pending post.
That's just a different point of view. Although it doesn't add a lot of context to his opinion.
That's the problem with moderation. People will tend to endorse what supports their beliefs. You can endorse a post you don't agree with.
Same thing going on here; the earliest and most active members are the ones who decide what comments are worthwhile.
This is terrible. Some people don't have time for HN every day, every hour and now these users have to suck up to the elite, early and most active members' preference?
To be clear, you mean you are going to stop maintaining the codebase of HN, not stop actively participating in the community, right?
I think it should be based on weighted karma/comment in addition to total karma. Imagine two users - one with 1500 karma & 1.1 karma/comment versus one with 600 karma & 10 karma/comment, which one would you trust to be able to judge what is a good comment and what isn't?
The total karma weight is to give at least some favor to frequent users, but not too much.
In addition, if someone replies to your comment, you should be able to at least see their comment regardless of your karma or whether it's been greenlit.
It would also punish comments on 'new' threads, which often stagnate with 0 or 1 upvotes.
If I post something and people post counterpoints or questions or concerns, I will respond. But the truth is that from a pure karma average perspective, by far the best action would be to simply leave the threads hanging, the single post floating at the top of karma heaven. That works great from a pure karma perspective, but it subdues conversation because every point is a single attack.
It also encourages the stealthy comment editor. While Paul mentions this, it is something that happens regularly -- people make a comment, someone responds unfavourably, and the original person subtly edits their comment to make them look unfairly attacked. This is a specific problem on HN given that quoting is generally discouraged. So everyone piles on the downvotes and upvotes, respectively, to right this seeming injustice.
Karma on HN is easily gamed, as it is elsewhere. It is unfortunate when we care too much about it because it leads to completely artificial conversations.
That's not an invariant property of participants with karma over 1000 points, to be sure, but the population of participants with over 1000 points skews to include a fair number of people who have been long-term contributors (patio11, who has my same join date and deservedly much more karma, immediately comes to mind among several other participants). What's practical about this bright-line rule is that it strictly limits the number of participants who can review pending comments at all, and allows the moderation team here to go to the next step of evaluating the reviewers, while ALL OF US are put on notice that what's desired here is substantive, polite comments.
So while I agree with you that the relationship "high karma implies good contributor" is not an invariantly true relationship, it has enough heuristic value to start as a seed for the system as further hand-tweaking of review power by the moderation team responds to your legitimate concern here.
You're making the related mistake that comments with lots of karma are good comments.
By coincidence, I (at the time of writing) have roughly 1500 karma at 2.2 / comment. Here's a selection of some of my sub-10-karma comments that I happen to like:
https://news.ycombinator.com/item?id=7203273 (for reasons I don't understand, 0 karma)
https://news.ycombinator.com/item?id=7276538 (2)
https://news.ycombinator.com/item?id=7156141 (3)
https://news.ycombinator.com/item?id=7396659 (4)
https://news.ycombinator.com/item?id=7239733 (4)
https://news.ycombinator.com/item?id=7352327 (5)
Here's every 10+ karma comment I've made in the past 50 days:
https://news.ycombinator.com/item?id=7206460 (10, with a 12-point comment two levels down)
https://news.ycombinator.com/item?id=7329150 (12)
https://news.ycombinator.com/item?id=7296981 (11)
https://news.ycombinator.com/item?id=7206436 (14)
https://news.ycombinator.com/item?id=7194772 (22)
Weirdly, the intuition I got from going back over these is that I'd probably use a threshold of 8 to divide "popular" comments from "unpopular" ones.
Anyway, I see a clear trend in the 10+ comments: they either openly mock someone, or they take a stand on a contentious political issue (the 22-pointer does both!). My favorite of them all is the 5-pointer, and I dearly hoped that someone would reply to it... but no.
Obviously, I've got plenty of less-worthwhile 1- and 2-point comments to my name. But I'm not at all convinced that someone with 10 average karma per comment is making better comments than someone with an average of two; it seems more likely that they're either demagoguing or just witty, possibly nastily witty.
postscript: average karma of some bright lights:
patio11: 15.2
cperciva: 11.3
tokenadult: 6.1
tptacek: 5.4
Is there some timeout? If not, commenting on a several-day-old thread will guarantee that you can never post another comment, since once threads drop off the front page it's not likely that many 1000+ karma users will even see those comments, never mind endorse them.
I'll add a pending page that collects pending comments. Maybe that will solve the problem.
Do we really believe positive moderation will be in the range of a few seconds to a minute?
I know there's been really great experiences[1] with negative moderation/flagging -- but then all users could flag, not just a subset -- and flagging something that's clearly wrong (as in goatsex wrong) is much less effort and much higher incentive than approving a somewhat contributing comment to a story.
Which brings us to what the goal of a comment policy should be. Should we really work towards discouraging people to post things like github-links to stories missing them, because sometimes they'll be beat to the punch by someone else, and now have to wait before contributing to the discussion on a different post?
Perhaps allowing "one pending post per story" might work better?
[1] I'm not sure which talk this was from, but I think it was "building web reputation systems" with an example from Yahoo that touched on flagging (users flagged in sub-second time, much better than automated spam detection). Not sure if this is the same thing(s), but they seem relevant to this discussion:
Randy Farmer (I think this is what I remember) http://www.youtube.com/watch?v=Yn7e0J9m6rE
Bryce Glass (similar topic/similar takeaways) http://www.slideshare.net/soldierant/designing-your-reputati...
(they are perfectly fine most of the time, their light-greyness is in fact more of an annoyance than the actually quite rare racist slur)
Whilst I am always intrigued with what hits the front-page, I rather more often than occasionally, find myself getting to page 10 or so on the weekends.
Just to see what has been going on that I missed.
Your change will basically mean that someone like me who might have something to add to an existing conversation might as well not bother.
It'll be years before I have enough karma on ycombinator's hackernews >1000, and that means I might as well seek another avenue. I guess I am back to post link on social media and comment on it.
Oh well, back to the 00's I guess.
That is already the case. Very few people read or participate in threads more than 24 hours old. You're already walking into an empty room and having a conversation with yourself; all this change does is lock the door.
[1] For example, not realizing that RC4 is now hopelessly broken, and asking for a couple of recent references.
I don't reread the thread, but I will pay attention to someone replying to my comments even after several days.
Also, (not unlike this comment) I'll find myself late to the party and add comments to posts because I believe my thoughts might be relevant.
I actually treat HN comments to be a ledger of sorts. Like other industry forums around the net, it is a collection of some very strong minds on tech-related subjects, and a decent resource to check for opinion or tangential information on all sorts of topics. If there is a discussion on something that I have unique insight to, I will post on long dead threads just to know it was posted.
I'm probably an outlier, and this use case is probably not all that prevalent, but pending comments being purged without endorsements would make this forum unarguably more temporal, for better or worse.
(well I have an inkling and it's spelled pretty clearly in the OP but I fear it may be considered "gratuitous nastiness", to speak my heart)
In my experience, page 2 is inaccessible after carefully scanning page 1 for a minute or two, and maybe clicking on or two links and reading the articles. Some generated link to page 2 expires during the time I'm scanning page 1.
Five years, I thought that was by intent and not some bug. Equally frustrating, but damn.
TLDR: Yes, Virginia, there is a Page 10 of HN. You'll just have to take someone else's word on that.
You have any idea how much time I spend sometimes on a comment?
(it can sometimes be quite a bit longer than the average person would on a similar comment, for reasons I don't really want to go into)
The first time one of those gets flushed down the toilet for no other reason than that nobody with >1k karma happened to notice it within 24 hours, I will know not to bother contributing any more.
Sometimes when I make a contribution to an older or less popular thread, I take the trouble anyway because I know there will at least be a few people that see it. Random passers-by, maybe in a few years arriving from some Google search. There's gems there. But I don't like to gamble on whether my post will even be kept around or not.
Downvote, bury, sure. But to delete without ever even being seen?? Well I guess it ties in with the joyful hellbanning theme here, or something.
Several sub-kilo-karma users may realize the same useful and valuable thing to comment (say, a reference link or clarification). They all post this before the first one gets endorsed.
All the others get penalized with a 24 hour no-posting timeout, for contributing a thoughtful/useful post.
(maybe a few of them will eventually get endorsed, so they may suffer a somewhat shorter penalty, at the cost of everybody else seeing duplicate content)
How about only placing comments into the "pending" purgatory if the submission they're attached to has received more than X comments in the past Y minutes? I assume it's the chatty discussions which you're concerned about cooling down, so this would handle the problem case while avoiding the side effect on quiet/abandoned threads.
Well, I guess it really comes down to just how much (proper) endorsing ends up happening. One thing I like about HN is that it's open and fast to use. Having a pending mode on everyone's comments affects not only the troll-users, but many of the normal ones too who aren't abusing the system ><.
I'll try to do my part, but I worry about the tragedy of the commons here. The current incentives may actively discourage endorsements.
[ed: spelling]
It's fun to consider that a dynamic system could provide someone on the back end (or a smart algorithm) with a variable nozzle controlling comment flow.
But, I wonder how the lack of visible scores on comments has affected the overall comment scoring rate. For the average new user today, how long do they have to wait to get to 1000 karma? How long was it a few years ago? These would be interesting questions to answer.
The best idea I've heard so far is a timeout, such that even if no one endorses your comment is to let you comment again anyway after a day.
I'm still not sure what the benefit of adding endorsements is compared to using a generic upvote as the endorsement.
Honestly, the more I think about this, the more complicated it seems, which is usually not a good sign.
If you really do want to reach some karma threshold I would suggest trying to get it from submissions instead. You can easily get hundreds of karma per submission if you submit the newest release of some popular software product or the latest Zed Shaw rant with very little invested. This also has the bonus that you are not actually lowering the quality of your commenting for more karma.
I'm mentioning this because I believe such posts are genuinely useful and surely deserve the points they get.
BTW I don't think I ever got near a hundred points for a comment. But I suppose it can happen in the above circumstance in a popular thread.
There are about 5500 such users. There have been around 245,000 users to ever post on Hacker News and around 85,000 users have posted over the last year.
Source: I'm working on a fork of the Hacker News Karma tracker (not ready to be live yet) that uses Algolia's new HN Search API; I also downloaded every comment ever made similar to how minimaxir downloaded all of the submissions.
Looks like in the last 10 minutes we've had 30 comments on HN - that's about 180 and hour - that's 4,320 comments in a 24-hour period.
Let's say 50% of those are worthy of being seen. If we assume it takes two upvotes per comment to bring it out of pending status then that group of 5500 people need to cast 4,320 upvotes a day collectively to to stay caught up.
Given the fact that A: it's unlikely that all 5500 of these users are still active, and B: it's very unlikely that they would be upvoting the same comments then it seems almost certain that there will be a SIGNIFICANT backlog of pending comments created each day.
Fluff will pass through.
Another option would be to enable the pending machine on big stories for the time they are on the home page, then auto-validate everything (but mark the unendorsed comments as such).
It would be nice if users with a lower karma could validate the replies to their own comments, once they have been validated.
Just from personal experience, if I have something to share on the topic, but the discussion already has a couple hundred comments, I look to contribute as a reply to an already highly rated comment. I'm much more likely to get actually engagement that way.
The issue isn't comment quality. It's UI. New comments, even on busy articles, should be discoverable. It should be possible to have discussions past the front-page-life of an article. It should be easy for the reader to decide whether to explore a given thread of conversation in depth or skip it altogether.
That should cut out a lot of concern about a ol' boys club, and honestly should do a lot to improve comment quality as well.
We could get away with temporary user names, changing on a per thread basis for instance, but that might be heavy to implement.
waterlesscloud's suggestion is to hide them only while the comment is pending. Once the comment is approved, then the username can be displayed as normal, allowing references.
If pending comments are applied to anything except the top-level, I could see this having disastrous effects on the quality of response in discussions since responses in low-traffic branches will likely not even show up.
Of course, it may be simpler to bot up a subreddit and do the same thing via convention. That may be the best result, redirecting the reddit-like dross back to reddit, where it belongs. Throwaway accounts will be mechanically discouraged along with the me-too, ya rite, and other useless posts.
I suspect the volume of submissions that are reposts piling onto something already on the front page (Erlang, Erlang, Erlang, Erlang, Haskell, Haskell, Haskell, Go, Go, Go, Snowden, Snowden, NSA, Erlang, Lisp, Lisp, Lisp, Lisp-flavored Erlang, NSA, Erlang, Erlang, Bacon and Spam, Javascript, Framework, Framework, NSA, Erlang, Haskell, Haskell, Erlang, Lisp, 2048, will dry up. I consider this a good thing.
I suspect I will spend less time on the site, either because conversations will become static expressions of views or because I won't have to filter through as much content, even though much of which marginalia I find quite engrossing. I consider this a good thing.
What comes next is open to conjecture. It could be a more mature salon full of reasoned discussions or it could become a ghost town with lots of great, old, discussions.
[1] I know, apocryphal at best.
At least measure the results, including people who give up and go away. It doesn't take much frustration to discourage even an active user with cogent remarks. I can see the quality taking a dive when regulars are driven away.
The above will allow people to submit comments even when the thread has lost its popularity.
On the other hand, I think it'll drop the number of really good comments -- those where commenters go out and lookup a few (possibly obscure, but very interesting) references. Doing that kind of work, just to have the text be deleted with hardly anyone seeing it doesn't seem worth it.
Which brings us back to the question of "What should HN be, for whom -- and how do we achieve that?".
Sometimes I ask a question in the comments, and it gets answered days later. I go through "comments" in my profile periodically to see if someone replied to those. In this process I also see if someone asked my something and reply there as well.
IMHO, HN should have a "private message" feature if comments get policed this hard.
The back and forth comments deep in threads no one reads are some of the most interesting I have had.
On the other hand, if I'm having a useful discussion with someone in an old thread, I often give them an upvote for their troubles as well. It's not like it affects the sorting or anything.
I don't entirely disagree with you guys, but I wonder why these discussions aren't being taken to email (or whatever you kids are using these days) anyhow.
Any time I learn about a new tech or shiny thing, I search for it on HN and read as much of the back and forth as I can. A number of times I've noticed those conversations didn't happen that long ago, even on old threads. Having it there is pretty invaluable to me to get perspective on stuff.
I actually think that coming up with a way of tying those old posts back into the new posts to continue growing those conversations would be nice. (take that as a total aside; I'm really shooting from the hip by even saying that, because any implementation I'd say would be an idea I had uh, well about ten seconds ago, when I suggested it, and it's not really relevant to the point at hand)
HN is primarily a news feed. There is some discussion, but it's topical and very short-lived.
I only mention this because the site seems a lot better once you give up on the notion of it being conversational.
I'm specifically thinking about topical conversations or discussions, where someone asks a question in a thread, or brings up a point and someone else finds it somehow and answers the question, which can lead to a series of enlightening posts/responses.
I like the HN comments because they have people who disagree, as long as the disagreement is civil, informative, and doesn't seem to have too much ego tied up in it. I like the reality check the comments offer.
But, it's not a good fit for the current format. Perhaps if when a thread got too deep, it could collapse and require a reader to actively expand it. That would help support the threads that start to push too far to the right.
But, it's probably better dealt with in a full redesign.
There really needs to be an entirely new kind of discussion forum, something that merges the various strengths of phpBB, IRC, newsgroups, and reddit. I have some ideas on that, but sadly not the time to code it. I hope someone beats me to it.
My ideal place would clearly define types of behavior that were to be discouraged. For instance, I like to err on the side of suppressing vitriol too much, rather than letting it run too much. I like environments where everyone feels like they can try to contribute, or participate, without wondering if it'll come back at them. I have pretty strong feelings about how far that should go, though, and it's usually further than a lot of folks would, or at least, further than a lot of vocal folks would go.
But I guess that's just it. I think generic karma/votes tend to promote a more general idea of what's popular, or fun, but don't necessarily promote a specific well-defined ideal.
Email isn't public discussion.
I use http://hnnotify.com/ , and it works incredibly well for this case.
Also, from what I've noticed, the Ask HN posts tend to receive comments of higher quality since the questions/submissions there aren't as sensationalist or polarizing, yet that particular section of the site receives only a fraction of the attention that the front page gets, so implementing the pending system there might unnecessarily stifle discourse.
After that, either nobody is posting anymore or the relative impact of a snide comment is quite low (in terms of viewership and also relative to body of the thread.) Usually after a day or two people are just ping-ponging in their own private threads and there isn't much need for the endorsement bottleneck.
The place where this seems crucial is in determining which comments end up being the upvoted root comments for the main thread. These comments are upvoted early on and ultimately end up forming the shape of discussion from that point forward, so it's a good idea to ensure they aren't flamebait.
And thank you for working on this!
I'm looking forward to seeing how this plays out.
I still think it's a net win though.
A few of us with very broken sleep patterns can put a little more effort into checking comment threads.
I tend to be awake at odd hours, and over a 24 period, it's quite interesting to watch.
Personally, I wouldn't read a "pending comments" page, because I come to HN to read and discuss stories that interest me, not to browse piles of random, context-free comments. I suspect that most users will feel the same, so it won't help much.
This entire thing is a bad idea, and the current state of Hacker News comments is nowhere near bad enough to warrant such drastic measures.
For those of us in non-US timezones, it would be nice to be able to post a few comments before having to wait while the site isn't getting much traffic. I would say something like 500 karma = 1 extra comment you can make before getting the previous ones endorsed.
This could be some additional meta-info to add to the 'post stories on Mondays'-"rule"...
http://arclanguage.org
Regarding the square bracket syntax:
http://www.paulgraham.com/arc.htmlhttp://en.wikipedia.org/wiki/Arc_%28programming_language%29
Now, since we're great guys and girls (having reached 1k karma) we wouldn't do that of course.
I still think slashdot has the least bad large-scale, distributed moderating system I'm aware of -- I think maybe being able to thread and filter on votes/mods is a better approach. Still, it'll be interesting to see how this thing plays out.
We'll see how it goes, but it does sound like it'll likely work against HN being somewhat heterogeneous, and (even more) towards group-think.
If you really want to make sure that every post gets voted on you may need to do something like that to incentivize endorsements.
That's cool because I can imagine for a picture site you want all pictures to gravitate around the consensus, a strong self-selecting group-think can be very desirable.
But for HN ... well at least the people who end up sticking around will surely love it ...
There were a handful of people who had multiple points per vote who could swing it drastically away from the 'consensus' if it was wrong, and doing so also penalized the people who voted for it.
>the thing I'd overlooked
but this is a drastic overhaul you are proposing, and I believe you have overlooked many other things too.
Let me give you some examples of other consequences: The amount of activity on HN varies with time of day. This is a problem, because on low activity hours, there will be fewer approvers (presumably, every approver has a particular taste, so the more people around, the higher the likelihood someone with compatible taste will find and approve your comment) around. This will mean that the few people that are there during the off-hours will have reduced posting speed. Since the site is more American than European, this will favor american posts over european. Furthermore it will be risky to respond to people down low on the page. Longer post delay! This will (further) encourage threadjacking people up high on the page. One potential consequence is that you will have to be attention grabbing. Probability of approval=eyeballs*individual probability.
I don't think this idea has been thought through enough to deploy.
I don't understand. The whole point of not being able to post until your previous post is endorsed--which is strictly separate and independent feature from invisible-until-endorsed--would be that people stop and reconsider "hm is this really the best I can do" because if it isn't they'll be muted ... indefinitely?
Or can you delete your own pending comment if it seems that no one is going to endorse it for you?
If not, that's going to become a huge chilling effect on unique thoughts and ideas that may either be controversial, or simply unpopular. Quite a stifling gamble. And even if you do get to remove that post from pending-limbo so you're at least not muted indefinitely, that still means the unique idea hasn't been shared, and in fact has been self-censored.
And will controversial ideas be endorsed? Because you said that endorsing the "wrong" kinds of comments will get your endorsing-rights revoked. I'm assuming, like all moderator-actions on HN, the user will get absolutely no notice or feedback about this.
Endorsing slightly controversial comments will be like feeling your way in the dark, err on the side of caution, better to just endorse comments that align with the perceived HN-groupthink (which may very soon become much realer, with this new system).
This is not a question of "but we have to be better than that", because these processes run on the aggregate of a very large group of people. Very large groups of people are vanishingly unlikely to "be better than that", no matter how clever, smart, talented or well-intentioned their individuals are.
So that will happen.
And that's just the collateral effects regarding content of posts (I say collateral because they are at best orthogonal to the quality of discussion on HN).
Like cperciva points out, if people are going to hesitate posting if they are unsure they'll be stuck in pending-limbo for how long or indefinitely, they are going to adjust their behaviour with regards to all factors that may influence how long it takes before a post gets sufficiently endorsed.
Which includes very irrelevant ones, like whether it's a quiet or new thread. Or, you know, making contact, silly stuff like "drop me a mail at <username>@gmail" between two sub-kilokarma users in a not-very-busy thread, risk locking their commenting privileges for quite a while.
Sorry if I dare to say so, but overlooking all these things, it seems like you just considered only the positive consequences of this big change, and none of the possible negative ones?
Then there's the final big negative one, which I think lacks a bit of self-reflection in order to overlook: HN already is quite the echo-chamber. These new rules are going to make that much worse. If, after a month or two of these new endorsing+feeling-in-the-dark+best-safest-to-conform rules do not make me feel like the quality of discussion turned into an ingrown toenail of monkey-discussion[0], then the most probable conclusion is: HN has turned into this echo-chamber (which seems quite inevitable), except it just so happens to be the kind of echoes I agree with. Which is probably worse than an echo-chamber you disagree with.
Hey, good luck. This community building is hard stuff.
Also watch out for the lure of power and control, it's also "hard stuff", of a different kind.
[0] your new rules are already making me doubt whether this is "gratuitous nastiness" or just a funny visual way of expressing a critique. this saddens me. it also makes me feel a couple of other things which I now don't even dare to express any more. that's bad.
What would help HN is a system for qualitative feedback to posters who make poor posts. Currently, users notice they are slow or hell banned, have no idea why, and register another account. Why not provide warnings with one or a few preweitten reasons? How about holding banners accountable for their bans, as some seem to ban contrarian viewpoints?
Anyway, good luck with this system. I'm unlikely to spend time writing a comment that may not be seen. I already care less about what I'm writing here, because I discount the chance that it may never go live.
This is why HN dislikes humorous fluff-posts: they both easily rise to the top, and encourage humorous fluff-replies, which means the first few screenfuls of comments will be guaranteed to induce the kind of "scroll-pain" that makes people close the tab.
I've yet to see any discussion forum solve the problem of long threads with lots of useless fluff floating to the top.
While I'm usually a kind of hard core html-first, ajax/js/webapps later kind of guy -- I'd love for the comments to be served up in a json-blob, with a couple of user-settable preferences ("Show only comments rated higher than N, hide threads with lower (median/mean) rating than N, show all direct replies to my comments -- and similar).
They use a very simple system, collapsing posts after a certain depth, and hiding more comments after a certain number (10, I believe) at the level below the top comment (sorted by score obviously).
It works extremely well, and thanks to the fast JS collapsing, it's not at all a hassle to read a subthread that happened to get collapsed if it piques your interest.
It's so simple it may easily be overlooked in its obviousness, but really you don't need a very complex system that is strictly a lot better than no collapsing at all.
If uninteresting comment threads could start collapsed, that'd be great. But they won't, because humor-fluff and other such things are superstimuli for upvotes, so you can't use anything about the vote tally to determine collapsed-ness. (If there was a secondary voting system--like, say, if enough people collapsing a thread would make it start collapsed for others--this might work. But then you'd have to take into account the people who collapse everything as they read it, to mark their place...)
The problem is, your definitions of what is uninteresting, useless and fluff are subjective, and no more relevant than anyone else's, which leads to a conflict of interests within the community about the bounds of what Hacker News content should and shouldn't be.
I think the models which would satisfy the most people are opt-in, in this case, choosing to collapse threads and ignore users rather than expecting the hivemind to do it for you.
Perhaps if users had a custom set of filters which automatically collapsed threads for them based on their own criteria, that would solve part of the problem. But I don't think it's too much to ask of people to actually take the minor effort to form an opinion on what they read, or curate their own account, if they expect content they don't like to be hidden from themselves and potentially from others.
But for some reason or other pg won't do that.
I know there's some extensions/bookmarklets and I use them, but they can't do the auto-collapsing based on score+amount, the very simple yet elegant algorithm Reddit employs, pretty much the one thing that is absolutely necessary to have a well-usable threaded commenting system.
Instead, pg "just wrote the simplest thing first", or something.
When everyone knows that what's being discussed is public, it tends to keep the tone more conversational and clear -- I think. The "feel free to contact me, email in profile"-response seems to work well enough for those that do want a private (albeit not anonymous) conversation?
eg:
Two commenters X,Y with sub-threshold karma (<1,000) could never have a dialogue (two-way, real-time) as a third party Z would need to endorse their each and every comment.
Two commenters X,Y (Karma 1,000+ each) in substantially different timezones with a-synchronous dialogue (eg, overnight replies) would need a third party z to endorse each and every comment (at least until the other wakes up).
Two commenters X,Y (Karma 1,000+ each) with opposing views, could never have a real-time dialogue without a third party z to endorse each and every comment (unless #)
Hopefully these are at least helpful to dilineate.
# "Thank you sir, can I have another".
If the worry is that comment threads are too long, HN could implement something like reddit, where you click to read additional comments in a long thread.
This system seems to skew discussion toward already popular / active topics, though, since there is less risk of being stuck pending there. Perhaps allowing for multiple pending comments per user (with a limit based on karma, or length of time on the site) would make it less "risky" to post comments in unpopular discussions.
Edit: After some observation, it appears to be two hours. I don't want to be pissy about this, but this is what I was worried about in my other comment--you seem to be making this drastic change with no little thought to how it will interact with the systems and behaviors already in place.
For example I recently gave a short comment on the PonoPlayer submission that never made it to the front page. For the rare soul that read that submission I indicated the electronics details that indicated how it was distinguished from your usual consumer electronics. That information would be lost from what I see here.
From my own experience, I often won't offer comments unless it seems to me that a contradiction to an existing comment or stream of comments is required, if I feel there is an error. While this system would require best argumentative practice in comments, for clarity and to avoid bias traps and so on, I do hope it doesn't lead to an excess self referentiality.
And keep in mind that an 'iffy' comment may not even be a bad one. It is pretty common on HN for more than one person to make the same basic point as someone else in a reply to a post (because they both started posting around the same time and didn't see the other replies before making their own) but due to either timing and/or karma boost pulling one person to the top, the rest are basically ignored for upvoting -- I can't imagine that situation would be any different for endorsing. Who wants to endorse a post that says the same thing as another post which is already endorsed (but just happened to be posted 30 seconds later, or by someone with less of a karma boost?).
So if you're not sure whether you should endorse a comment, don't. There are a lot of people on HN.
This is true, but so much good stuff flies by on /newest without picking up an upvote (or just one or two) that I'm not entirely convinced enough people fully participate here (or maybe /newest just isn't quite the right way to do that job either, I admit I don't go there every day myself).
I think you're doing the right thing. I've watched HN start to turn into a place full of snark and very useless comments. This is a great measure, but is the 1000 points karma a high threshold for the endorsers? Why not 500 or 750?
Will there be a "show pending" setting (for users with under 1000 karma and/or those with >= 1000 karma)?
The other failure mode I can think of is that there are plenty of high karma users who make occasional intemperate comments. I myself have been guilty betimes. Are you at all worried that such folks will just go back and forth endorsing each others' bad comments?
Re: your plan to check out of HN. You will be missed.
Not speaking for pg, but he's stated in the past that growth was never a goal for HN.
HN could lose a lot of users and still be no worse off than it was 4 years ago, and it was pretty OK 4 years ago.
Can someone with over 1,000 karma start replying to a fresh comment before it's endorsed? Or will the reply link not be there until it's endorsed? If it's the latter, I'm worried that this might stifle the (admittedly rare) back-and-forth discussion between two experts, such as tptacek and cperciva. People who want to reply probably won't sit and wait until the reply link is active, and since replying to a different comment than intended is taboo, they're likely to say nothing instead.
That's a minor concern though.
EDIT: Also,
Since I'm going to check out of HN at the end of this YC cycle,
If I'm reading this right, does this mean you're going to leave HN entirely? I'm sorry to see that happen, but I understand why you'd need to.
Why wouldn't they just endorse each other's comments and continue a meaningful dialog?
User names are shown next to comments now, but I find that my eye gravitates to the text of the comment. I used to think I had an "enemies list," that is I used to think that there were other participants here who I would reflexively never upvote, but in fact I have found that among all the user names I recognize, I have from time to time upvoted comments from all of those participants. (And, in general, to fight the rot here I try to upvote the good stuff at least as often as I downvote the bad stuff. Changing either the numerator or the denominator can change a signal:noise ratio.)
But if it's not too much technical trouble (I have no idea about that issue), sure, we could let pending comments live on the basis solely of their content, with their authorship being exposed when the comment itself is exposed after review. I could live with that, as a user who has enough karma to review under the new system.
There are a lot of users with > 1000 points.
edit: not one, a few.
And you don't know that it's not going to swing the other way, where people would be more likely to speak out because no one's going to endorse the stock replies - i.e., the exhausting nits picked over this comment: https://news.ycombinator.com/item?id=7418937 wouldn't all be there.
Are the endorse links far enough from the flag links to avoid fat-fingering issues on mobile devices?