Show HN: I ranked news websites by speed (legiblenews.com)
1. I got tired of waiting for news websites to load, so I made a text-only news website that only has major news headlines.
2. I wanted to demonstrate to the world that if you want to build something really fast on the web, you can do it without loads of JavaScript.
3. I wanted to show that you can design something that looks good without having tons of images, etc.
I put together the speed page at https://legiblenews.com/speed to hold my website to be more accountable for speed, but it's also interesting to see how fast other news websites are (or in most cases, are not).
Some feedback I'm interested in receiving:
1. What's your take both on the speed ranking methodology for Legible News?
2. Are my descriptions of the metrics for a non-web developer reasonable? Example of that at https://legiblenews.com/speed/websites/associated-press, and if you click through the links on that table, you see a description like https://legiblenews.com/speed/audits/cumulative-layout-shift
Sorry ahead of time, but I can't fit all news websites on the speed report. I had to target general news websites, not ones for specific niches like HN for Tech. If there's something you think that's missing please post it, but I can't promise that I'll add it.
If you like it, please consider subscribing! Thanks!
205 comments
[ 1.8 ms ] story [ 228 ms ] threadI'll go ahead and say that yes, this is somewhat self-serving, but I'm hoping this puts pressure on some news websites to get their act together and make their primary news websites faster for everybody.
---
Edit: I've pushed out the updates
1. Individual speed reports now include a link to the text-only sites.
2. Methodology makes a mention of it at https://legiblenews.com/speed/methodology (I still need to refine it; wrote and published in haste)
As well as CNN, NPR has one too: https://text.npr.org
There's also http://68k.news which is particularly nice because it hyperlinks to images in the stories rather than embedding them.
You don't need commercial interests to think about UX. The early web looked the way it did mostly due to hobbyism and undeveloped UX standards that we take for granted today.
Looks very clean, thanks for this
Oddly enough legible news only got an 86: https://pagespeed.web.dev/report?url=https%3A%2F%2Flegiblene...
:-)
Cranking up the Dynos to keep up.
Which BTW, that's the funny thing, Heroku is super duper slow, and I still manage to run a reasonable fast news website.
Here's response times under HN load: https://s3.amazonaws.com/bradgessler/Eu1cKE24dpKjTkqNcK3qPqH...
99th percentile is at 175ms.
https://edition.cnn.com/2022/06/28/entertainment/tom-hanks-f...
https://lite.cnn.com/en/article/h_fdb58e07457b1cd96266160502...
Does anyone know how to automatically map one to the other?
CNN too at https://legiblenews.com/speed/websites/cnn
Honestly, I never notice load times from news sites because they're all an advertising cesspool and I run Brave + layered ad blockers on my computer and mobile devices. As a point of curiosity I wonder how these sites would compare with ad blocking enabled.
But at the end of the day I care a lot more about their serious, reliable content (or lack thereof) than a few milliseconds. I'll wait 3 seconds for good news rather than 200ms for trash.
(Not at all saying legiblenews.com is trash. I've honestly never heard of it. I'm just speaking in general terms here.)
I wrote a little about that under "Less is more" at https://legiblenews.com/speed/why.
I don't really expect slow/fast news websites to be a big deal for the HN crowd since we all know how to run ad blockers in our browsers or PiHole.My goal here is to make less technical people aware of the speed they're sacrificing when they read websites like CNN, Fox News, etc. There's a lot of privacy implications too I'd like to make people aware of, but I haven't found an easy service/scanner like Google PageSpeed Insights.
"Trash news" is a real problem, and no offense taken to the fact you've never heard of Legible News. I source headlines from Wikipedia, which is why I donate to them for people who buy a subscription. Legible News is more of a news aggregator than anything, which links of to news institutions that people have heard of.
https://en.wikipedia.org/wiki/Portal:Current_events
How are you pulling your data? (there are 3 different Wikipedia APIs, with various levels of data).
I suggest you look at the the Features Content API (https://en.wikipedia.org/api/rest_v1/feed/featured/2022/06/2...). This could be fun for you to use, since it also gives you a list of the most visited pages on Wikipedia in the previous 24 hours, which often surfaces interesting topics of current event.
Nice job on a cool project!
- https://www.theguardian.com/uk is fast and snappy
- https://www.bbc.co.uk/news feels like a hyper fast mobile website
Both degrade wonderfully well (minor glitch on the Guardian "most read articles" HTML on mobile but otherwise all good)
I built Legible News for people who are non-technical and don't know how to disable JS, install ad-blockers, or run a PiHole.
Maybe there are solutions for this out there already, ill have to look
I like how you've put the ranking by speed and I think that's a really good way to advertise your service. That being said, $9.99/mo seems pretty steep for what is basically a really fast aggregator of other sources. The $1/mo to Wikimedia is good but really just a small amount going to the creators of the actual content. $25/mo for the NYT does give you a slow website, but you know they're funding investigative journalism with it.
Edit: My mistake, it's $9.99/y, not /mo. That is way more reasonable
Source:
https://legiblenews.com/plus
Can you share any stats around the conversion rate for how many visitors end up converting to your Plus service?
https://webperf.xyz/
It's a 3 day running average that is focused on Article pages (not the homepage), against the mobile version of article, tested using Lighthouse.
Each site gets tested 1-3 times a day.
All historical data is available in Google Sheets (linked from main page)
https://docs.google.com/spreadsheets/d/1sGKmbnW74u9r1GOzAQcI...
That said, it is possible to make drastic adjustments that help monetization, UX, and still have ads. I did that as a short-lived experiment for a very ad heavy mobile site (SFGate):
Main points are here (not a ton of details) in this sanitized post-redaction deck:
https://docs.google.com/presentation/d/12ds0b4nTxzcDy23te0Zm...
I had an extra labeling for non-ad sites so there was some distinction and would like to restore that.
However look at El Diario - ads and number 1 spot!
DotDash has numerous high performant sites (ThoughtCo etc) that have ads too.
This is the superior tracking-news-website-speed tool.
I also get the actual paper delivered in the morning, so if I need something "performant" or have a poor connection I can simply read it in print. So I appreciate that the website offers something more than just an online duplicate of the print experience.
I wonder if the NYT would see an increase or decrease in conversions if they switched to a more performant but less progressive design system. Would more people convert on the fast load time? Or are the special effects diving more conversions (as they did for me personally)? I think they must have done the math and concluded that their business aligns more with the latter.
I don't include in the rankings because their distribution isn't wide enough, but I'd guess they're relatively slow for the reasons you mention.
I feel like it could be much faster at around 50ms or so with a cloudflare caching setup on the page, may be wrong.
I'll probably deploy this to https://fly.io/ in the future to a few different geographies around the world so that I can bring latency down for the entire planet while saving myself a boatload in hosting costs.
I wonder if fly.io/heroku matters for the servers however. Caching the webpage with a CDN sounds like most bang for buck right? One request is slow at the start of the day for the news (maybe its a user requesting far away the main server worst case) but every subsequent request is served from close to user CDN. (Not 100% if thats how it works in practice)
Speaking out loud here just to see if server location matters if you have a good CDN setup or something I'm missing which would make requests need to hit the main server.
So it doesn’t matter how fast you build the site. You don’t have control over the things that make it bad.
Yes, I've run big websites and they're kind of like sea faring vessels -- given enough time with a large enough team, they tend to collect barnacles and become slower over time.
I made the speed rankings so that Legible News wouldn't lose site that speed matters.
Do you see why we all use it?
No way to win. At least I could wrap all the ad locations so they didn’t shift the page when they finally popped in.
I'm not sure that a 10% donation to Wikipedia from subscription revenue is quite enough when you are doing quite a simple reformat of all the volunteer work that goes into the current events section of Wikipedia.
You are effectively changing $9.99 for a weekly email digest of the https://en.wikipedia.org/wiki/Portal:Current_events page and giving them $1. I think if you went 50/50 on it I would probably feel it was more fair, you are adding value but I assume thats all automated.
I will give you credit for your 100 score, that page on wikipedia gets an 86 on page speed insights.
Related Wikipedia page on reusing it’s content:
https://en.m.wikipedia.org/wiki/Wikipedia:Copyrights
Note: there was a bug that I fixed at around noon PST that wasn't display this link for daily news articles, but it was for the contextual articles.
I intend on fully complying with Wikipedia's copyright notices. If you see otherwise please LMK because its a bug.
https://www.timeanddate.com/time/zones/pst
Heck, my coworkers use PST all the time (ah, timezone pun?). One of these days I should honor those timestamps to the letter.
Regarding, "not enough", I'm currently losing money on Legible News, so if I increased the amount, I'd lose even more money. For now I consider a 10% donation generous given the current unit economics. I may raise prices to offset these loses, but I'll grandfather in people who subscribe today.
If Legible News reaches a large enough scale I'll consider switching from the current donation model to a Wikimedia enterprise subscription (https://enterprise.wikimedia.com/pricing/) or hiring my own editorial staff to put together the days headlines.
---
Edit: Oops, there's a bug on the news articles that are not displaying the license. If you want to see what this should look like, check out https://legiblenews.com/articles/Mekelle and scroll to the bottom and click on "License".
Fixing this now for news articles.
---
Update: Licenses are now working for news pages. You can see today's at https://legiblenews.com/june-27-2022/license. This broke navigation at the bottom, which I'm now fixing.
The problem now is that fixed costs are barely covered. Once that hump is achieved I can start playing around with donation allocations more. It will take some time to get there as the cost structures aren't that well established yet.
> The news content and links from them are from Wikipedia
How are you losing money if all of your content is from Wikipedia, and presumably free?
In fairness, it doesn’t seem to be offering much at the moment, but I’m genuinely curious about the directions the owner imagines taking the project.
Current costs are:
1. Hosting - $30-$60/mo depending on traffic levels. The more subscribers, the more this will cost.
2. Workstation - Its fractional, but the workstation I use to build this isn't free.
3. Dev time - This is the big one. If this is to become sustainable, I'd need to build up subscription fees to pay for a team. $200k/engineer, administrative staff, and whatever an editorial staff costs if I go down that route.
Saying "it costs nothing" would be a recipe for eventually shutting down this website since I'd be working towards none of the infrastructure above that's needed for this thing to continue on without me.
I also want to build out a mobile application, which also costs money in the form of App Store fees and dev time.
Keep in mind: I'm not targeting the HN crowd with this, who know how to find CurrentEvents, throw it in their RSS feed, find the optimized mobile version, etc. This was built for people who don't have the time or knowledge to do the digging needed to find and format this content.
What HN found interesting was the relative rankings of news website speed, which I hope brings awareness and results in faster websites for us all.
Stick it on Netlify and that cost will drop to $0.
Does the cost of subscription pay for the hosting costs? It sounds like this is the only current hard cost, so hopefully it's growing slower than the associated subscription revenue!
> Workstation - Its fractional, but the workstation I use to build this isn't free.
> Dev time
I mean, no offense, but it sounds like you don't actually have any costs besides hosting, and you'll break even somewhere between 40 and 80 subscribers.
I think what everyone's objecting to is your misrepresentation of the content on the home page as your work. Nothing on the "today's news" or "about" pages credits Wikipedia or its contributors.
[1] https://old.reddit.com/r/IAmA/comments/i8j5te/i_made_a_free_...
What??
Because running a website like that should cost basically nothing.
This feels in very bad taste to me. As another user pointed out, these articles are being authored and maintained by volunteers, who are donating their time and effort to make information accessible to people. Instead of joining them in that pro-bono effort, you're trying to leverage their work to your own profits. Yes, it requires some up-front work from you to format the articles, but it's a one time cost while the authors are continuously working. And sure, you have to pay for hosting costs, but then you could still run it as a non-profit that only recoups costs and donates the rest to Wikipedia.
If you want to make a business out of this, I'd suggest investing in having people author some original articles. But taking someone else's volunteer work for your own gain is not something I will support. Not wanting to invest your own time and money to make your project work long-term doesn't justify using other people's time and efforts to make your project work long term.
If there's any part of your data pipeline that I misunderstand and rectifies the situation, I'd be happy to have my understanding fixed.
I do want to acknowledge and be upfront that I won't be able to satisfy everybody's level of fairness, taste, etc, but this is currently what is sustainable for me given the amount of time and resources I have available to put into this project. Some will think this is done in very bad taste, like yourself, and others won't. That's fine! I accept constructive or thoughtful critiques and will reflect on them in the future as things change.
> You are free to:
> Share — copy and redistribute the material in any medium or format
> Adapt — remix, transform, and build upon the material for any purpose, even commercially.
This seems like exactly the kind of behaviour they want to encourage. It's not taking anything away from the project, just adding another way to consume the information for those who choose to.
> Under the following terms:
> Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
> ShareAlike — If you remix, transform, or build upon the material, you must distribute your contributions under the same license as the original.
> No additional restrictions — You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
Proper attribution is not optional. While OP's license link might put him in the clear legally (although IANAL, it might not) it is can still be questionable ethically and I agree with the other commenters here thinking it is.
Presumably, if Legiblenews takes off and doesn't add value, Wikimedia is free to compete with it. Wikimedia could form a for-profit company that donates more of user revenue to the foundation and feature that company on Wikipedia. Therefore, for the foreseeable future, Wikimedia effectively retains the option to copy & crush Brad's side-project. And if Legiblenews takes off Wikimedia does nothing at all...they will still almost certainly receive more $$$ than the current state of the world.
In that way, Wikimedia is outsourcing innovation to Brad, who Wikimedia is well-positioned to copy/compete with in the future, and being paid to do so. While Brad loses money.
I'm not 100% sure who is on which side of "fair," but ultimately if it complies with Wikimedia's license I'm good with it. And if you don't like it, why not start something better?
They're presumably also benefitting from the work volunteers put into Linux, nginx, and whatever else is in their stack, but nobody suggests that websites using open source technologies should be forfeiting all profits.
Delivering good news is expensive! The big players are not doing that for the most part, instead doing "newstainment" and I almost never pay attention.
Indie journalists are challenged right now, but are doing News. Most can barely make it.
Your platform could help! Having them author and get some revenue would be something I would pay for. And I do that now via Patreon, Substack, others. It is all too coarse though.
All that said, maybe plenty of people will pay. You are likely to find out. And like I said in my other comment:
Speed is nice, but compelling rules!
Maybe invite those getting views to author original material. Helps you, them, the reader / viewer.
Random internet user: “such bad taste to reuse Wikipedia content, I should complain on their behalf“
https://pagespeed.web.dev/report?url=https%3A%2F%2Fnewsasfac...
[0] Is hard to consider local news like "Two policemen and a polio vaccinator are shot dead by gunmen on motorcycles in North Waziristan, Khyber Pakhtunkhwa, Pakistan" relevant news.
[1] https://gtmetrix.com/reports/www.slowernews.com/XOAMfY1i/
Indiatimes & Times of India aren't the same, from the internet aspect.
As soon as the outside consultant leaves, everyone pushes their internal initiatives again and the sites get slow and bloated.