61 comments

[ 1.7 ms ] story [ 25.9 ms ] thread
Pangram 100% is notoriously difficult for humans to do, even with intent.
On how much text? There's a fair few reports that it's quite inaccurate when given smaller samples of text, and if you go cherry-picking the odds will likely go up even further.
It's in the article - looks like they ran it on a book.
No, they say they ran "passages" of the book through it.
My neighbours regularly remind me that AI is quite different in French - despite being Francophone they tend to use it in English for what they think are better results.

It's entirely plausible detection is totally different in different languages.

> a writer with an exceptional life-story

Sounds familiar

Note 'Balance ton Claude' is an oblique reference to 'Balance ton porc', what's commonly considered the French equivalent of the US #MeToo cultural event
What's the big deal? If the book is good, it is an excellent use of AI.
Like it or not, people expect significant AI-use to be disclosed. When only human is credited, they feel cheated.

Excellent use of AI? Disclose it and avoid the fuss.

Do you disclose the use of a typewriter? Or word processor app with auto-complete and spelling/usage checkers?
No because people don't care. Basically you have to deal with the expectations of your readers when you try to sell a book.
Sure, and expectations were met here by the readers[0]. Otherwise there would have been no award in the first place. It's just this random group with an axe to grind that's trying to stir up trouble.

[0] https://fr.wikipedia.org/wiki/Prix_du_roman_Fnac

It got banned from Goncourt. Looks like not disclosing AI-use didn't met expectations.
You're missing 2 key bits of context: the when and the stated reason. Goncourt had the novel on their long list until this accusation surfaced, and explicitly stated that they removed it not because they found the content lacking after all (which would be a strange retrospective), but because they "had taken note of the AI and plagiarism accusations"[0] and acted thus. Goncourt has no idea if the novel was primarily done by AI or not, but they're going with the narrative because they have their brand to protect. Heck even the mud-slinging group had to use a tool, because they have no idea otherwise. And there's still not 100% certitude; all they have is a "very likely", but their narrative took like a flame to a dry forest because of the current AI controversy.

[0] https://edition.cnn.com/2026/09/26/europe/frances-goncourt-p...

I'm not going on a political rant. I was just saying it's fair to be transparent and disclose significant AI use.

From your previous message, you seem to not understand the key differences between a spellchecker and a LLM, and as a result, why generating a whole book winning author contest could be seen as controversial.

> Heck even the mud-slinging group had to use a tool

Yes, and they disclose it.

For the few pages I saw on X it's actually tiresome to read.

Lots of short sentences. Lots of weird metaphors. Many infamous "it's not x, it's y".

Tell us so we can make informed decisions?

"Why do you care is there is horse meat in your beef burger patties if it tastes good" vibe

What's wrong with horse meat?
The writing is pretty terrible and shlocky but the topic is what the committee is looking for.
Agreed. It’s not like a particular word is any different when it’s made by ai.

Would we care if someone used a typewriter vs a computer to write it.

This looks like a weird snobbishness. The fact that it’s by Europeans makes it more funny since they have been left out of the AI race.

In the end you have a final product. Can critique it on its own. He used ai to help write it and you couldn’t tell before, says more about the product and perhaps you don’t like what it says about you .

This story smells odd; why does anybody care about the accusations of an anonymous twitter account? A claim seemingly without evidence no less.
>He is also a finalist for the most prestigious annual French language awards, the Goncourt and the Renaudot, set to be issued soon.

If I had a book that was hoping to win this award, anonymous accusations like this seem like a pretty easy way to shift the odds. It's impossible for the author to disprove the allegations and the award committee will want to 'avoid controversy'

This isn't the first high profile case of a black person being reported with accusations of using AI this year[^1][^2]. Once or twice, sure, whatever. But a third time now? It's hard to think this isn't anything but targeted, especially given this particular case the group making the "claims" are entirely anonymous.

[^1]: https://www.independent.co.uk/arts-entertainment/books/featu...

[^2]: https://www.thetimes.com/uk/education/article/jason-arday-re...

Are the accusations untrue? The evidence that i have seen seems pretty compelling.
Is it that, or is it because marketing "content" by a minority author with an "interesting life story" is an industry not an art, and they're less likely to care how the "content" was produced?
Pangram is making the "claims", not some group. It is known to have a very low false positive rate, especially on long texts. And there is now also evidence of plagiarism, rather than just AI writing, in his other work (see down thread).
What’s the false positive rate multiplied by number of books in print? This seems like a fraught use of odds / stakes.
The longer a text, the more entropy, the easier it is to classify. Novels are pretty long. So I suspect the false positive rate for books is far lower than for articles. And, as I said, we also have corroborating evidence now in form of cases of plagiarism discovered in his past work. Someone who has no qualms about committing plagiarism is more likely to also not have inhibitions about using LLMs to write books.
They tested passages. It is absolutely trivial to find passages that pangram classifies as 100% ai gen even if it's not the case.
I don't think it's trivial. I'm also pretty sure many people have tested the whole book.
Where? Can you post a link?
This story is international news. It is extremely likely that many people have checked the full book using Pangram. I need not post a link for that.
It's not extremely likely, you definitely need a link to back this claim.
"He is black, you cannot accuse him of anything, you racist."
“It was just a coincidence that most American slaves were black”

I don’t think anyone is saying skin color conveys immunity from accusation. But I hope you can see that the odds that a dramatically higher per capita rate of accusations against people with a particular skin color should at least give pause.

Three black people in a year across the literal entire planet’s population and you are convinced it’s a racist conspiracy?
How many non black people have been accused though?

Why would they target these specific 3 black authors? I assume there are hundreds/thousands of successful black authors, 3 "this year" seems very small to call it a targeted attack

Depends on how you define «they», but the public discourse in Norway the past two weeks have been defined by the Norwegian news outlet Manifest Media publishing a series of articles about AI “meat proxying”, starting whith an analysis of commentators employed by the Norwegian Broadcasting Corporation (NRK). The one found guilty was a white woman, and among the four non-guilty was one non-white man: https://www.manifestmedia.no/artikler/slik-testet-vi-nrk-for... A follow-up article targetting (white male) professor Asle Toje found that he had probably used AI to write a much-discussed opinion piece: https://www.manifestmedia.no/artikler/pangram-tojes-omstridt...

Race has not been a part of the public conversation. Not sure if it would have been that way if the guilty person was non-white (but I'm slightly optimistic, given that the first person found guilty was a woman and gender was not part of the discussion).

It's 2026. This defence is not working anymore.
It's hard to think this isn't anything but targeted

By whom?

A simpler (and easy to think of) explanation is normal systemic racism. Black writers are likely underrepresented in the training data begin with, so the models assume Black writing can't be real.

It is possible that the works of black people are tested more, possibly by racist people systemically putting them through Pangram in hope of getting a hit.

If that's the case, unfortunately, they're bound to find legitimate fraud eventually. Given the subsequent hard evidence of plagiarism, it seems like this is one such case, and we can't exactly ignore it.

I remain convinced the whole notion of AI-detection algorithms with any semblance of precision and accuracy is a con.

Critics say the author almost exclusively relied on AI to create his work, based on Pangram’s findings.

Pangram says it “is trained specifically to detect the latest AI models from frontier labs like OpenAI, Anthropic, Google, Meta, DeepSeek, xAI, and more. [They] benchmark against 26 models (so far)…”.

I can probably list more than 26 models off the top of my head. Granted, some models have been distilled against others and will be “detectable” but that’s NOWHERE near a large enough sample size to be reliable in 2026.

You or I could get a flag by that detector in our first attempt, and it wouldn’t take long for a false positive against enough attempts of truly original thought either.

The only thing I’d actually believe is things like Claude’s text watermarking system. However, those systems will never be present for EVERY model, so reliable blanket detection remains an impossibility.

The entropy in written text of meaningful length is simply too great for detection to be reliably possible in 2026, especially considering the changes the author can make.

(comment deleted)
This was discussed a lot on the news here. Couple of authors feed their pre AI books to pangram and also got false positive. Maybe it is AI, maybe not. But using AI to accuse someone else of using AI is ironic.
Can you post some links? I know some authors said that, but had used a different tool than Pangram, and I don't expect non-technical people to understand the difference. Pangram is reputedly the best of them and personally I couldn't get a single false positive on my own work (both French and English).
To give a bit more information:

* Media ran the entire novel through Pangram and got a 94% AI score [1], whereas all other Goncourt finalists, Haitian/African novels and French classics they tested came out as 100% human. I recall they also tested works specifically from before and after the AI boom and found a shift, but I don't remember where I saw that.

* People on social media, as well as traditional media, have then found cases of blatant plagiarism in Orelien's work a decade ago (this includes one prized short story and several posts to blogs and media) [2]

I think we have to be careful not to assume that tools like Pangram are completely accurate and the word of God, but we can't dismiss them outright, and this particular author's history of plagiarism makes it much harder to give him the benefit of doubt.

[1] (French) https://ici.radio-canada.ca/rci/fr/nouvelle/2286476/thelyson...

[2] (French) https://www.lapresse.ca/arts/litterature/2026-09-23/thelyson...

> ""We tested several passages, from different bits of the manuscript, to come up with the identical result: 100 percent AI," the group said on X."

I.e. they're using AI output a black-box truth oracle, without understanding how it works, or being able to independently reproduce its conclusions as human thinkers.

Perfectly healthy habit for society to normalize.

Any Francophones, does the book sound like AI? I find that in English a lot of the time that something is accused of being AI-written and people cast aspersions on the quality of AI detectors, that when you read the text it’s immediately obvious as AI: chock full of em-dashes, not-x-but-y constructions, unnatural metaphors, and so on.
The first two chapters can be read online. The text is full of metaphors (many nonsensical), staccato sentences and X not Y constructions. The rule of three comes up every other sentence, often combined with a zeugma. No em-dashes though!
Why use AI to write at all, I wonder? Writing is the fun part. I'm not interested in having my bot eat my ice cream for me either.

I do use AI to help learn concepts, to grammar check and spell check, and to find errors. And I always tell it not to rewrite anything. I'll fix it myself, thank you.

It's always fun to see stuff I wrote decades ago get flagged as genai, though.

I am with you, AI is a tool, and it matters how you use it.

I believe overuse of AI will be detrimental to your cognitive function, because the brain, like most organs in your body needs "exercise" to function well.