Very cool. Here's a similar ranking that takes average scores into account. It surfaces a lot of the smaller domains that get a lot of HN love: https://hnleaderboard.com
This sort of thing is an excellent seed for host authority if you're making a search engine. Often the trick is to find places where humans have curated 'good' web sites out of the sea of all possible web sites. HN is a good source of data because you get several human signals, one is up votes, the other is comment points. Between the two you can create a rank for both how non-spammy it is and how controversial it is.
HN is a good source of data because you get several human signals, one is up votes, the other is comment points. Between the two you can create a rank for both how non-spammy it is and how controversial it is.
Correction: how non spammy Dan thinks it is and how controversial Dan thinks it is.
His judgment is an ok proxy. But please be precise when saying things like that. The upvotes in particular are almost meaningless in a centrally controlled site like HN.
It’s the moderators’ role to manually decide if and when a certain story reaches the front page, and how long it spends there. Not the community’s. And unfortunately the content of the front page varies dramatically depending on who is manning the helm that day.
If you don’t believe this, simply try to ask about any of this publicly and he will rip out your ability to speak on HN. That’s how important it is to maintain the myth of the community-controlled website. Because after all, if the content of the site is not our decision, whose is it? Better to force everyone to believe that their upvotes matter.
If anyone wants to help plan a way around these problems, please message me on lobsters (same username) or email me. The current idea is to make a cross between HN and Reddit: you can make a "subteddit" but use all the same moderation tools that HN mods normally do. That means you can edit titles, rerank the front page, muzzle individual users without banning them, detach comment threads, collapse threads, and generally everything you can't do on Reddit.
Thanks for that reminder (I was going to say: “I wish I could sort this by average or something instead”).
Neither are perfect though. A lot of the best articles come from the BBC. Yet because so many people submit (and resubmit) BBC articles, they have an awful per-posting score.
I think you’d want to pre-filter by submissions that actually got some traction (made it to the front page?) and then look at the score distribution.
Does this have any meaning to anyone? As someone that enjoys submitting articles and trying to find patterns in their success or failure, I do not see much significance in where the story came from as opposed to a catchy title or subject. I'm often surprised by what catches and what flops for what that's worth.
I find it surprising that nytimes takes 2nd overall, top in news category. It means nytimes is doing things better than others, and the news industry is very motivated to figure out how to make digital work.
Hello. I created the site. I think it can be useful to browse domains for certain sites. For example, Github.com can be used to browse popular projects. aws.amazon.com can be browsed to keep up with large AWS announcements, and www.reddit.com can be used to see top posts on reddit.
Why did I create this site? Because it can be very difficult to keep up with tech news. There are great new stories on HN every single day. I simply can't keep up. The solution? A way to browse top stories from the past week/month/year or all time. I am letting the wisdom of the crowds decide for me what is most important, but it is nice to be able to take a vacation without worrying I will miss something big. I still read HN and other tech sites almost daily, but this helps me review the more popular stories which can be both interesting and fun.
It oughtn't be. You might not like their opinion pages -- yes, they're typically left-wing -- but The Guardian's reporting is absolutely top notch; amongst the best in the world.
How do you differentiate between opinionated/politically biased pieces and general reporting ? What's the criteria for evaluating good (ie trustworthy) reporting ? Curious to know.
No. They constantly blur editorial features and news. The most shared posts are ludicrous hysterical nutters that they give a platform to because it generates clicks.
To me, the interesting number is average points per submission. It's surprising to see how badly medium.com, forbes.com, and theregister.com do by that metric, and how well stripe.com, ifixit.com, and blog.rust-lang.org do...
Shout out to danluu.com — literally the top average score for the last year and in the top few for last three years (per https://hnleaderboard.com/ ). Probably my favorite blogger and it seems popular with HN as well.
Is this just cumulative? It seems to me that ordering by average score would be better, is Github simply pushed to the top for being low rank high volume?
This seems a frequent problem. What is the most robust formula for sorting by average while boosting by frequency? Something like avg(ratings) * log(len(ratings)) ? Maybe that curve needs to be tweaked based on the use case ?
I wish sites like amazon had something like this, since sorting by average rating is completely useless if you have a long tail.
Hello - I created the site. I would encourage you to take a look at the 'links' section which is something you probably have not seen before. It aggregates and comment urls and ranks by count for a variety of sites - including XKCD!:
Very interesting and well done. Something seems off for the 'ask' page though. "Top Ask HN stories from the past year" but most only have a few points.
In terms of product organisations, the top ones on the list is Mozilla, AWS, Cloudflare then Apple ... wouldn’t have guessed that (part from maybe apple)
I am surprised by wikipedia’s performance. How does an encyclopedia (even and excellent and ever evolving one) beat out the Washington Post for topical news?
The wikipedia links submitted that make the front pages are almost automatic reads for me. They aren't news so much as obscurities, and are usually pretty fascinating.
I agree that they can be good. It’s just that whatever someone will surface in 2020 was probably sitting there in 2012. Why didn’t we look at it in 2012? Surely there is a listing of obscure topics. But somehow it becomes a must read in the HN context. (I do it too)
Well done! Did you consider using other metrics (like median instead of mean) or other techniques (e.g. removing outliers, calculating confidence intervals, considering the standard deviation, etc.)? I'm aware that things can become complex (to visualize and interpret) and maybe not many people would be interested in something more complex than the mean. :)
51 comments
[ 3.6 ms ] story [ 109 ms ] threadCorrection: how non spammy Dan thinks it is and how controversial Dan thinks it is.
His judgment is an ok proxy. But please be precise when saying things like that. The upvotes in particular are almost meaningless in a centrally controlled site like HN.
It’s the moderators’ role to manually decide if and when a certain story reaches the front page, and how long it spends there. Not the community’s. And unfortunately the content of the front page varies dramatically depending on who is manning the helm that day.
If you don’t believe this, simply try to ask about any of this publicly and he will rip out your ability to speak on HN. That’s how important it is to maintain the myth of the community-controlled website. Because after all, if the content of the site is not our decision, whose is it? Better to force everyone to believe that their upvotes matter.
If anyone wants to help plan a way around these problems, please message me on lobsters (same username) or email me. The current idea is to make a cross between HN and Reddit: you can make a "subteddit" but use all the same moderation tools that HN mods normally do. That means you can edit titles, rerank the front page, muzzle individual users without banning them, detach comment threads, collapse threads, and generally everything you can't do on Reddit.
(cough cough reddit)
Shawn: we know HN is curated. The mods do a good job, that is why it is not a shithole like reddit.
Find a new hobby instead of being obssessed with someone else's platform like an angsty fixated five year old.
I think I offered to help you write a resume. The offer stands. I’m sorry things deteriorated between us.
Best of luck.
Neither are perfect though. A lot of the best articles come from the BBC. Yet because so many people submit (and resubmit) BBC articles, they have an awful per-posting score.
I think you’d want to pre-filter by submissions that actually got some traction (made it to the front page?) and then look at the score distribution.
example: https://hntrending.com/domains/year/github.com/
Why did I create this site? Because it can be very difficult to keep up with tech news. There are great new stories on HN every single day. I simply can't keep up. The solution? A way to browse top stories from the past week/month/year or all time. I am letting the wisdom of the crowds decide for me what is most important, but it is nice to be able to take a vacation without worrying I will miss something big. I still read HN and other tech sites almost daily, but this helps me review the more popular stories which can be both interesting and fun.
I wish sites like amazon had something like this, since sorting by average rating is completely useless if you have a long tail.
https://hntrending.com/links/all/xkcd/index.html
You can view summaries of Wikipedia articles or abstracts of arXiv papers on the site as well.
I hope you find it useful!
top multi blog site: medium.com
top tech news site: techcrunch.com
top social media site:twitter.com
top journal site: arxiv.org
top cloud provider site: aws.amazon.com
top for-profit company tech blog: blog.cloudfare.com
top personal blog: drewdevault.com
top disregard of users' data site: www.facebook.com
LOL
Has anybody else found the web button largely useless these days?
I am surprised by wikipedia’s performance. How does an encyclopedia (even and excellent and ever evolving one) beat out the Washington Post for topical news?