Show HN: Boring Report, a news app that uses AI to desensationalize the news (boringreport.org)

1166 points by aquaVitae ↗ HN
In today's world, catchy headlines and articles often distract readers from the facts and relevant information. By utilizing OpenAI's language models, Boring Report processes sensationalist news articles, transforms them into the content you see, and helps readers focus on the essential details. We recently updated our iOS app experience, so any and all feedback would be appreciated.

App Link: https://apps.apple.com/us/app/boring-report-news-by-ai/id644...

345 comments

[ 3.1 ms ] story [ 312 ms ] thread
I feel like the kind of person who would use Boring Report is also the kind of person who's brain is already discounting sensationalist titles and doesn't really need an app to do it for them. That being said, I'm all for trying things to make the news more measured and nuanced.
I disagree, as I think this would be useful to people with anxiety disorders who don't want to entirely disconnect from the news. Just because they may be able to logically identify articles and headlines as "sensationalist" doesn't mean their brain won't still kick off some uncomfortable physiological responses.
What exactly does "desensationalize the news" mean? Is there any additional detail on what exactly it does?
What exactly does "What exactly does "desensationalize the news" mean?" mean?

I think what you're really saying is: "I'm less interested in the work this person did to make something cool; selfishly, I'd like to know if it follows my biases so I can judge it based on politics."

Or you're just curious how it works and haven't spent the effort trying it out, which is valid.

This is unnecessarily presumptive and negative. They have a simple question - and that doesn't mean they didn't try it out to see how it works from the user side of things.
The way the question was asked was not asked as if by a person who was simply curious, so yes I was negative.
What a weirdly aggressive attack... Either I'm selfish and have a lot of biases or I'm lazy.

Could it not be that as a person with an interest in AI and general technology I am wondering if there is any detail on what does an "AI" look for to determine a "sensationalist" title and how does it "desensationalize" it?

I have scanned the twitter feed and the app and just wondering if there is anything on how it works. The answer can be no.

I'm not trying to attack you, I was dissecting your intentions, which I'm now noticing came off as super rude and I apologize for that.

But let's be frank... It's clear through your verbiage that you were either thinking about this politically or were actually just curious as I stated in my previous message.

I never said you were lazy, there are many reasons why you might not be able to try out the product right now and it's totally normal to ask questions when you assume others might have answers. It's also possible to do selfish things, or think selfishly at times and not be a selfish person, I was not trying to antagonize.

Sorry for misunderstanding your intentions, for some reason when you asked "What does desensationalize exactly mean?" I read it particularly negatively.

I read the OPs comment seemingly in a completely different way than you.

To me, it's just a comment asking how it may work (technically). Pretty normal to ask that on HN. The persons feelings or intentions aren't reflected in the comment and I think aren't relevant to the question either way.

I think it's the word "Exactly" in his sentence that changes the meaning away from "I'm intellectually curious" for me. I'm just reading between the lines but the op can change their intention as they please and deny so whatever I say at this point is irrelevant and it's likely I was being too cheeky.

Wouldn't someone who was intellectually curious just ask: "That's interesting, I wonder how it works?" and not: "What does desensationalized exactly mean?" which is overly negative. Incidentally, I'm being accused of being negative for pointing that out.

May I polity just say that perhaps defending yourself to this many people is unneeded. You said your two cents, hammering the same nail with a different hammer won't get the nail in any deeper. I've already completely moved on, you should as well. We are in HN, not reddit, let's all get a long as best as we can and discuss the matters at hand. I have no problems with you, I hope you have nothing against me.

My intentions were not negative, if it was interpreted that way I apologize, same as you I type the way I type.

So you can be rude, but I can't be a little cheeky, roger that. I have no problems with you and I hope you have a great day!
They were not rude. You were not a little cheeky.
FWIW I also read:

> What exactly does "desensationalize the news" mean?

as being snarky rather than curious.

It'd be interesting to see a variant of this app with a slider bar, allowing one to drag a widget to see the exact same stories but with say, far-left, left, center, right or far-right biases applied.
What I find most ironic about this is that rather than bringing users closer to the source of information it potentially pushes them farther away by adding an additional step to verification. I imagine you've considered this? How easy does your app make it to access the source article and author information, for example?
Looks like the original URL is at the top of every story.
We readily make available the source article on both iOS app and website. We want to serve as the stepping stone for information about an event that would encourage people to seek out more.
What? You mean make news headlines useful?

* rapturous applause * if this works.

You can't just reword things and get a better result. If there actually is an alien invasion and the earth is actually doomed, that's actually the correct headline.

Media literacy is about way more than about the wording of headlines. It's also about understanding why a headline was selected, who benefits from a story, whether the story is internally logically consistent, and why were the people quoted selected, context of the story that you wouldn't know just from reading it, etc.

I say this as someone that wrote a browser plugin to do something similar in like 2011 by screening words that indicated the headline was pointless.

I agree. Although one side effect of the Boring Report's approach that I quite like is that it also seems to make the headlines more informative.
> In today's world, catchy headlines and articles often distract readers from the actual facts and relevant information.

A reasonable premise! But easier said than done. I wonder how this app counteracts the hallucination and lying behavior of LLMs.* Would be pretty bad to trade off easier-to-decipher human bias and sensationalism for distorted truths and lies from an obfuscated sequence of dot products!

* I assume they are using LLMs because they state:

> By utilizing the power of advanced AI language models capable of generating human-like text,

Usually it hallucinates when you're asking for information, in this case it's rewriting existing text, so it should be a little safer. When in doubt check another source, as with everything.
People should doubt everything an LLM outputs, ergo, why use it in the first place if the desired output is objective fact? LLMs hallucinate, that's what they do. When it's wrong, you likely won't notice that it's wrong, but over time, your world view is going to become more and more distorted.
> why use it in the first place if the desired output is objective fact

rewriting facts is like 90% of all writing jobs

I think there will be an art to these "information summarization" products. You want just enough summarization to accomplish the reader's goal, while also minimizing your hallucination surface area. Summarize too short, and your user won't get what they came for. Summarize too long, and watch user trust crater as the hallucinations pile up.

I don't think there's a generalized solution to this problem for all information domains, so when search engine companies implement it it'll be low quality. What remains to be seen is if the money is in being a curator/aggregator within a niche, as Boring Report aims to be; or if it will be in selling the specialized summarization tech to the content creators directly - for use by them when they publish. I think the latter leans B2B and will have higher quality since the content creator signs off on it. But we'll see. Either way, the right mental model for LLMs may be to treat them as memetic compression algorithms.

Add some localization to include country specific news and theme filters and I'd pay for this without hesitation. Free me from this cacophony of ever repeating "content" news.
Localization and further customization is on our list of priorities, so say tuned. Thank you for your interest!
This is a great concept! Thanks for sharing. I do have to wonder, though, if this is a Band-Aid over the problem of sensationalist reporting. Assuming there is a market for “boring” news (I think there is; I’d like to read it!), wouldn’t it be cheaper to pay journalists to write less exaggerative pieces in the first place?
There are boring news orgs, but how many are you subscribed to? How likely are others to find them?
I think counteracting the market forces that drive exaggerated journalism would be far more expensive and difficult than simply developing some software to filter the exaggerations locally. Also, we can work on the first more effectively with the second in hand.
Try ft.com. Most of their revenue comes from subscriptions, not ads, so they are not striving to generate clickbait like most papers.
In an ideal world yes, but the incentives are not there. For example, many governments benefit from media being sensationalist, within and outside borders. They don't want less sensationalism. I think this "attention to negativity" is something inherent to humans, and now that we have opened the door, I doubt it's gonna close by everyone paying more to journalists.
I would posit the minority of people are drawn to more "boringly" presented news, and as such, it wouldn't make much sense to have it be the primary artifact. (for better or worse)
If there is a x million dollar market for boring news, there's an x+a million dollar market for the same news that's less boring
I'm generally excited about something I'm calling "English to English translation" - and this is a good example.

Previously translation has focused on going between languages.

I think there's just as much benefit to translating within a given language.

* Translate corporate speak to plain English.

* Translate passive aggressive to calm and peaceful.

* Translate sensationalist to neutral (like the OP).

* Translate implicit and heavy with subtext to direct and assertive.

you are missing "rewrite email i don't want to read in the style of <author i like> influenced by <other thing i like>"
The same concept applies to so many things

One time, local-dialect subtitles completely changed a movie experience for me

It was an American movie. Where I was, they usually watch movies with english audio and neutral Spanish subtitles

This time, instead of neutral Spanish, they used local Spanish with slang… wow, what a difference in the way the movie felt

Having local language and slang can convey meaning and emotions so much more effectively

Proper translation is an art form... if you have the budget.

Otherwise, it's someone typing as fast as the movie goes on the first viewing.

Another use case in the arts: interpreting literature and finding connections within and between books
I am looking forward to a tool to summarize a 10 page long Terms of Service into a list of points about what I really need to beware of. Same for legal contracts.
My favorite is pasting something into the chat with "ELI5"
What you described is known as "sequence-to-sequence learning", or seq2seq. Google it or ask ChatGPT. It's a very common NLP technique that can do almost everything you mentioned.

Of course the utility will depend on the training data you collect. For example to go from corporate speak -> english you would need thousands of pairs of "translated" sentences. Or you could use an LLM to translate for you, paying as you go

This is great, but I didn't realize that was a video at the top of the page; I think it needs the 'muted' attribute for it to autoplay.
Hey, dev on this project, thanks for the heads up! Fix should be there soon.
I need an alternative YouTube homepage that generate video suggestions without clickbait titles and thumbnails.
But how will you know what to click on without a goofy face with a shocked expression?
is anything of value lost by suppressing youtube videos with thumbnails containing faces showing happiness > 0.9? i suspect not.

this probably functions decently well as a "europe vs america" discriminator.

I use Procrastination Free YouTube. It has settings to customize YouTube so that you don't see any suggestions at all. If i need to watch a video, I have to search for it. In order to not miss Videos from people i want to follow, I use NewPipe on my phone.
Use BlockTube to block any channel that uses clickbait thumbnails. That's what I do. I don't care if "but their content is calm and good", if they use clickbait thumbnails they lose all views from me forever. There's no shortage of channels on youtube that don't do that, so there's no reason to tolerate the ones who do.
JPMorgan Chase CEO Jamie Dimon testified before a Senate Banking, Housing, and Urban Affairs hearing on September 22, 2022. Dimon mentioned that as the U.S. nears a potential default on its sovereign debt, markets could experience panic. ...[1]

He said that today, but in an interview with Bloomberg. The source article[2] just illustrates it with an archive photo from 2022, when he testified in a Senate hearing. Similarly, the Disney article[3] starts non-sensically The Disney+ logo was displayed on a TV screen in Paris on December 26, 2019. Disney shares decreased by 9%[...] (I don't think displaying the logo 4 years ago is to blame).

I suppose you should just stop parsing image subtitles. The two articles I checked were otherwise accurate.

[1] https://www.boringreport.org/app/all/645cfc85bab323b21e6195e... I had to use the developer tools to copy paste the text, obnoxious. You also can't right- or middle-click the source link (to copy it or open it in a background tab). Don't hijack basic browser functionality.

[2] https://www.cnbc.com/2023/05/11/jpms-jamie-dimon-warns-of-ma...

[3] https://www.boringreport.org/app/all/645d0cebbaef7c040f89ca4...

I've come around to there being legitimate usecases for this type of generative AI, but I don't think producing anything that's supposed to be "True" or "Correct" is one. I think the only useful usecases is for when you want to generate fiction.
If you tell GPT-4 specifically to respond with proper jargon for the domain like that found in a textbook or journal it provides much much more useful replies. Silly that prompt engineering is what's required but at least for my purposes wherein I fact check it's output it's right nearly all the time and I've learned a great deal.
Even then there's literally nothing stopping it from making shit up.
Sure yeah, for now. Just saying I literally use it to mine out things to confirm (/ not believe until I do) and so far it has very rarely led me astray and even then it's been small nuance. It's striking.
What do you mean "for now"? Yes, right now, at the most impressive it's ever been, it has this fundamental flaw.
Which is hilarious considering humans make shit up, lie and parrot falsehoods _constantly_. Even without intending to.
Assuming you're serious and not just knee jerk reacting to the flippant way I replied, this is pretty much exactly what I meant. The full text of this short story I can't find a good link (old ones I've read are broken links now) but this reading on YouTube will suffice.

Asimov, The Last Question https://youtu.be/ojEq-tTjcc0

It doesn't mean it's less biased. All of these styles are exploited as a form of rhetoric. Many people simply take information written in a textbook style as authoritative.
And that's why I ignore the people that laugh at the whole prompt engineering thing, because it's a genuine skill.

At the moment GPTs are trained on so much data across so many domains that you have to treat it like a person who has similar knowledge.

If I just walk up to you and start sputtering jargon about a very specific complex topic, when you were just chatting to another friend about all sorts of everyday topics, you're not going to be able to reply to me immediately.

With these GPTs it helps to get it "in the mood" for your topic by preloading keywords and shifting the topic over and deeper so your desired topic is clearer to the attention mechanism.

Writing summaries of documents and correspondence is one of the major use cases of those models. Desensitionalization and debullshittification are very similar to summarization, so it stands to reason LLMs should handle these tasks just as well.
Summarized bullshit is still bullshit akin to a polished turd.

Given that the choice of which articles to write is incredibly biased to begin with this approach does not seem effective.

What could theoretically work is an “AI news agency” that “summarizes” many different sources to generate unbiased articles.

> Given that the choice of which articles to write is incredibly biased to begin with this approach does not seem effective.

Selection bias is a given. You always have to keep that in mind. But when you actually want to read a specific article, summarizers are useful. For news and general population content, debullshitifiers could come in handy too.

Point being, the texts are not random. There's some nugget of valuable content in it, but it's usually wrapped by enormous layer of SEO, ad hooks, word count padding, and/or general nonsense. Reducing signal-to-noise ratio here - stripping all those layers of bullshit - is strictly useful.

I’m not arguing summarization is not useful, or stripping the various sources of noise you listed.

“Debullshitification” reads as de-biasing which is not what you just itemized.

My point is rather that Fox News+LLM (as an example) is still biased but would appear/may be incorrectly presented as unbiased to a reader not acutely aware of selection bias which is probably not something an average reader is well informed about.

No, you’re applying a specific meaning to an inherently nebulous term, debullshitification.

And honestly, I immediately knew what that meant when I read it. My preferred news source, which isn’t horrendously partisan, still has…exactly what I’d call bullshit. If that’s removed, I’ll get more bang for my buck in reading it, and that both provides immense value, and something that I’d call “debullshitification”, whilst working purely from the articles provided.

Since you mentioned nebulous, this is the Oxford definition:

> verb: bullshit; 3rd person present: bullshits; past tense: bullshitted; past participle: bullshitted; gerund or present participle: bullshitting

> talk nonsense to (someone), typically to be misleading or deceptive.

It’s reasonable to interpret debullshitification as removing bias (i.e. what is misleading or deceptive in the news article) in this context rather than the “fluff” listed.

As I stated in the comment you replied to, GP has a different definition and I agreed removing fluff definitely has value.

It's reasonable to interpret debullshitification as "removing bullshit." Specifically, "the reverse process of bullshitification."

Speaking nonsense, misleading, and deceiving aren't the same as "adding bias." They're just techniques that can be used to do so.

>What could theoretically work is an “AI news agency” that “summarizes” many different sources to generate unbiased articles.

NewsMinimalist does this, it’s quite interesting. I’ve been using it since its introduction, and its been a fun way to get lots of summarized, de-sensationalized headlines. Specifically I enjoy setting it to 6.0 and reading the headlines that have impact that didn’t quite reach the 6.5+ threshold.

https://news.ycombinator.com/item?id=35795388

Another great idea though also very US centric like the app in this post. Hopefully this comes to more places
It's like trying to make Chinese food using McDonald's Happy Meals for ingredients.
They have McDonald's in China (at least in Shenzhen) - if you were to take ingredients from there, this may actually work.
I would not and do not trust them to do this in cases where I care about the accuracy of the output.
If you care about the accuracy of the output, don’t read news in the first place? I think you’re trumping up the impotence of this use case.
I’m to the point where I’d probably put more trust in an AI generated news summary than many of the sites that purport to give me accurate and truth worthy news.
For a lower-tech approach, The Flip Side is pretty good at doing one story each day from 2 different sides. I was a bit annoyed when an excited friend signed up my email address without asking me, but I have never unsubscribed because I find it refreshing in a typical world of frenzied news.

https://www.theflipside.io

Screwing it up isn't a crime. Papers can retract and re-visit a line of thinking. While nobody loves doing that, I think it'd help.

In addition I think it'd help if papers hammered the party line of Dems and Republicans far harder. My running joke / dare is: send sportscasters to DC for a year. At some point they'll call BS on everything and everyone, and start questioning with both barrels. BS is less tolerated in sports.

Take taxes. Trickle down is BS. But it's also true the top 5% or so pay 40%-60% of taxes while the US Congress continues to spend in debt. How we'd get here? Who's primarily to blame (Congress). And what is Congress gonna do to fix it?

Show votes by Congress members year by year against deficit, debt, and ratio paid by corps, rich, middle, and poorer Americans. I wanna see both aisles running for cover.

Biden's budget envoy was in Congress about 6-8 weeks ago. She mentioned biden's plan was raising taxes on corporations and individuals with $400k or more in earnings. But when the republicans pointed out the fact above (5% paying more than half) she had nothing.

What's the republican code here to de-construct? Well lack of fairness, and an implied destruction of jobs and income for workers if taxes are higher. Ok, how do you defeat that? Dems are empty. And tax payers will ultimately have to bear up under both parties stupidity if this continues.

I didn't grouse too much about how the government (mis)spends money so long as debt to GDP isn't stupid and there's some attempts to get real. But in the last 10 years, I've changed. Who wants to send cash to DC? DC has got serious trust problems.

I agree, having AI sportscasters would be kinda cool.
I've come around to there being legitimate use cases for journalism, but I don't think producing anything that's supposed to be "True" or "Correct" is one.
The calm, serene assurance and objectivity of the GPT outputs have been a breath of fresh air amidst the stupidity of the average social media discourse. If this style somehow prevails it will be a net positive for the internet. I for one welcome our new LLM overlords!
Hey, other dev on this project. This is a good catch, and we're aware of this issue. What it's doing is actually using a photo caption as part of the article, and we're working on removing the use of that in the summarization process.
Maybe image search and if the image is not novel, ignore it?
Good point (it seems to me), and if it's AI generated, (try to) ignore it too I guess
Why? If it is an AI generated image, it was generated from a text prompt, by the author of the article. Author had reviewed the image. The image is novel.

As long as this is novel content, it should be parsed, I think.

(comment deleted)
Parsing pdfs or web semantically is really not an easy job, as I found in my own foray into LLM sumamrization.
Their are news APIs

Start with those and then figure out how to scrape a site as your input and spit out the existing API format and you'll come in through a clever side route, essentially having a two phase assembly line.

Also this will allow users to customize their "feed" as a free side effect of the architecture and furthermore you'll be able to isolate your scraping -> API transform on a per site basis, also as a free consequence and lastly, you can parallelize the work much cleaner and even have the public add their own "transformer" for their favorite news site

In fairness to the AI, I have often been confused by stock images or old images on news articles that are not from the event in question.
Photo attribution is a bit of a problem. For a tornado in Kansas they may use an image from another year’s tornado in Mississippi. For the war in Azerbaijan they might use an image from Chechnya, etc.
True, I have a photograph taken in Kenya that has been variously described as in California, Guatemala, Colombia, Australia and South Africa.
That is precisely the type of editorial affordance I would expect the AI to strip. This is just another way for media organizations to distort the news. I look forward to those enhancements
False metadata for rich media is a damned tough problem to target.

Putting aside any actually truthful captions, how do I know that "image of X" is actually an image of X?

Reading some of the Bellingcat investigations, and time spent, doesn't bode well.

I guess you could TinEye and index/hash the entire web's worth of rich media, then spot discrepancies (listed as X here, but Y there), but that seems horrendous in compute/bandwidth/storage terms.

>>seems horrendous in compute/bandwidth/storage terms

Yes, but the usefulness of being able to automate that identification in near-real-time to debunk the firehose of falsehoods we get from everywhere would be astronomical

Anyone reading would have a huge edge in both being more accurately grounded in reality and being able to identify the biggest/hottest disinformation streams

Honestly given the quality of Stable Diffusion and similar, you don't even need to reuse the same image posted somewhere else, you can just make it up. So... making such a huge effort...for what? People will adapt to use new tech.
That's a different problem. An important problem to be sure; but different. It's the kind Reality Defender are trying to solve to the extent it's possible and I am afraid it's just a matter of time before we see the effects of this in some crisis point when we can least afford the time to make sense of the firehose of falsehoods (nice phrase btw).

https://realitydefender.com/

AI can just fabricate a new photo for any event.
It sort of becomes obvious when everyone in the photo has seven fingers and two thumbs on each hand.
> This is just another way for media organizations to distort the news

No, it's not. This is done because stories with images perform better, and obtaining images (& licenses) for photos of every event is not always possible.

'Perform better' is frequently ..not synonymous, but amounting to the same as 'distort[ing] the news'..
The fact something makes the article perform better doesn't mean it's not deceptive.

Indeed, a major incentive towards inaccuracy in journalism is the pursuit of impact.

Yes, it does distort the news.

If I read a story about a riot and the included picture is from a different but similar urban disaster scene that shows buildings on fire and windows broken I come away from the article with an internal expectation of the disaster scene including fire damage and broken glass -- but that isn't necessarily the case.

This happened constantly with the reporting around the BLM social unrest.

Articles sell better with additional sensationalism, but when the narrative being espoused doesn't conform to reality then it is a distortion, regardless of the motivating factor.

(comment deleted)
I'm sceptical about how good you can make low-quality source material. If you've managed to train an AI to find the little nuggets of truth that the headline is based on, that's cool. But if the topic is relevant, there will be an article from a reputable source about it.

With the current advancements, is there finally a browser extension that just hides clickbait titles/thumbnails?

You could just read the Financial Times.
Will definitely use that for my next dopamine detox cycle.
I’m kinda curious how this would make truly sensational news completely blasé
personally i'm not interested in seeing the news rewritten by gpt as it stands. but if you could automatically find the least sensational article on the subject, and then send me to that site, along with a plugin that just highlights the most salient points, and fades the worst parts to grey, that'd be interesting.

i'd also like to see a service which shows me the news about subjects which have managed to stay in the news for at least a week. just drop all the 24-48 hour rage/hype cycles.

Please allow me to pay you so you can focus on this full-time.
Thanks for doing this. This is something I've been looking for since ChatGPT was unveiled generally. I wish Feedly or a similar RSS/News-aggregator would add a feature like this ... it would make so much sense.
We plan to implement RSS support as well, so please stay tuned. Thanks for the support.
Ha! Was just scrolling about to see if anyone asked about rss. I think you are onto something, I know i will keep your app installed for a while. Good luck and well done!
I'm a paying feedly customer . FWIW I would move into your paid service if you implemented rss. I moved to feedly when greader was killed, but never liked feedly that much.
I've also been thinking about processing news with LMs, but from a different angle.

One big complaint I have for reading news through RSS, is that there's no natural hierarchy/priority to the news. There's no front page, no headline, no size in RSS feeds. Given the way news agencies generates those feeds, there are _tons_ of repetition, tiny updates, some insignificant one-liner interview about some significant events. Not to mention the "no update at this point" updates. Entries that are not informative look exactly the same as---but often outnumbers---the entries that are informative.

An ideal news feed processor to me, would be one that reads through last weeks RSS feeds, and merges the all those tiny updates into coherent articles, ranked by the significance of the event. Sort of turning newspaper into a journal.

The merging and reflow should be well-within an LM's capability. However, I'm not sure if OpenAI's API can swallow an entire week's worth of RSS, or produce multiple full-sized articles, but this is something that I'd like to try when I get some free weekends.

I had nearly the same idea as you around surfacing what is "important" vs just a large list of RSS articles.

The main differences compared to what you are thinking are two things. One for the `Significance of the event` I've used the number of publishers talking about that event. So more publishers == more important. Two, I've done this in a daily fashion instead of a weekly report.

I can also confirm that the LM has the capability to do at least a days worth (2500+) of articles. I would doubt its capability to produce an entire article but it does a great job at a small summary.

Here is the link if you wanted to check it out. https://apps.apple.com/us/app/quill-news-digest/id1669557131

Are you curating the list of publishers somehow? I would imagine the AP/AFP newswire repost circuit/echo chamber would result in overestimating importance of a lot of crapola and underestimate the importance of investigative pieces for example.
This was an issue when I first started. With minimal sources a lot of time the top collections were low quality SEO articles.

After adding a sufficient amount of sources I've noticed a decent reduction in the echo chamber. Although by ranking importance by the most talked about topic, it is going to have some sort of echo chamber.

Adding left and right leaning publishers for instance has helped. Although one might say something is good and something is bad, the embeddings pick it up as the same topic.

In a way it also cuts through bias.

I just downloaded it, looks pretty useful especially for news sections I don’t follow particularly closely.

Will check this out over a few days.

Out of curiosity have you looked at deep you can go while still getting quality results (i.e. beyond top 2-3 in each heading)?

A related idea that I’ve had is to present a time-lagged newsfeed and use AI to link to any follow up stories.

“hey, remember how everyone was panicking about the price of eggs a few months ago? Well, prices are normal now but only one person wrote about it so you probably didn’t hear that”

People get the impression that mostly bad things are happening because “this just got much worse” is newsworthy but “this isn’t as bad as it was 5 years ago” isn’t, and improvements tend to happen slowly whereas disasters can happen quickly
I love the idea! I was thinking about doing sth similar to my medieval content farm (https://tidings.potato.horse/about) but as a personalised feed, where I can apply different “soft” filters to different types of content, eg. remove garbage tech-bro language, provide outlines/shorter versions of sensationalised content, reference related articles from different sources. Essentially, I was thinking about replacing my poet/editorial team personas with different user personas.
I wrote a small utility to send the AP news feed to GPT and ask it to judge which stories are important based on how many people they affect and how time-sensitive they are. ie. Will this story still be important tomorrow?

Only the passing ones are then delivered to me.

I'm not releasing this as a product, it's too simple, but it works surprisingly well, and it's trivial to add criteria for what you deem to be important, or not.