238 comments

[ 0.27 ms ] story [ 10.7 ms ] thread
How many of these "news" articles are we going to get?

This for me, isn't interesting, it required no skill, no imagination, in fact it seemed like it happened by dumb luck.

So we have entered an age where an army of know-nothings direct models to old forgotten tasks so they can get 15 minutes of un-deserved attention?

If human "skill" and "imagination" are your requirements for interesting, you're going to become permanently bored fairly soon I reckon.
> If human "skill" and "imagination" are your requirements for interesting, you're going to become permanently bored fairly soon I reckon.

What? Why? This has been my bar for my entire life, and I've never been bored for a single second.

Well at least the skill aspect will soon become so niche that essentially nobody will bother with the investment. So on reflection maybe not permanently, just mostly bored.
I doubt it. For “skill” there are any number of sports; for “imagination” there are any number of stories and other mediums. It’s not like every human has just decided to roll over and not do anything anymore; quite the contrary.
Too bad Bletchley Park didn't have one back in the day.
I'd be curious to see whether these models can create new forms of unbreakable encryption themselves!
Careful what you wish for. The swarm will probably use it to communicate.
We already have a plethora of cryptographic algorithms that literally anyone can use to send messages nobody can read with current technology, unless of course they have the key. You're using at least one of them right now to read this website.
"They are trying to generate hype before the IPO so that they can cash in before the bubble bursts"
Maybe I'm wrong - but it seems like some strange form of competitiveness.

They don't care about the advancements themselves, only that the advancements are some sort of cheating that shouldn't "count".

Humanity is profoundly unsettled by AI and is responding with avoidance and denial.

I wouldn't be surprised if humans cracked it then OpenAI "bought" the solution and work to claim it was GPT's doing
wild conspiracy given what else has come out of these companies.
For anybody interested, the actual encrypted message:

  BTTE UM ANGABE DES MARSQWEGES X BEFINDE MIQ IN X ROSENOW ROSENOW X SOFORT FUNKANTWORT X WASCHBBSCH
which, given misspellings, translates approximately to:

  Please specify the route of march. I am in Rosenow, Rosenow. Immediate reply by radio. Waschbusch.
The place is Rosenau actually.
Different Rosenow. In July 1941 the SS was busy invading and beginning occupation of the Baltic states and western Russia.

https://www.maparchive.ru/nara-doc/Waffen-SS/3_SS_PANZER-DIV...

> Daily reports and sketches pertaining to offensive engagements across Lithuania in the Gvardeysk and Ukmerge areas, 22-28 Jun; advance across Latvia and offensive operations in the Deguciai, Daugavpils, Zidina, and Dagda areas, 28 Jun-4 Jul; and invasion of Russia and offensive and mopping-up operations in the Rasina (Rosenow), Opochka, Isaki, Zaborov'ye, and Gorki areas, 5-19 Jul 1941. Also periodic division circuit diagrams, 29 Jun-18 Jul 1941, and data on enemy operations.

was the misspellings deliberate?
i would assume yes, to throw off decyphering. even more impressive that they managed to crack it
> i would assume yes, to throw off decyphering. even more impressive that they managed to crack it

Were operators of enigma machines aware enough of cryptology or the weaknesses of enigma, for that to have been done intentionally to prevent decryption? I doubt it, otherwise _many_ things should have been done _much_ differently by the operators.

I'm surprised "Bitte" --> "btte" was a hurdle. "Bitte," or "please," is ubiquitous in German. The more common the term, them more likely you'd be to see some contractions. Dropping the "i" is pretty logical- anyone looking at it would see immediately what it meant.
To be clear, the text in the comment is the plaintext, not the ciphertext. The plaintext is what's full of typos.

The ciphertext of message Nr 172 was:

MVUEH IDEVS ARMCC NQTAT YEVFC DBZGG SMXWL PSYWZ YTCBS WURRT BZCVG ODVJU SLSOO MJQJZ SXSEB ZPEYM DNXJF TC

https://cryptocellar.org/bgac/g-army-july-1941.html

Looks like Q is used as an abbreviation for CH
Interestingly, in MARSQWEGES -> MARSCHWEGES, but not in WASCHBBSCH (WASQBUSQ)
Do we have any kind of transcript as to how the message was cracked, and whether this was cheaper or more expensive than simply Bombe-style trying all the combinations?
As the article states, the LLM built code for both an enigma simulator and a bombe simulator.

Breaking enigma is often about using lucky or educated guesses to heuristically reject large chunks of keyspace to leave the remaining keyspace computationally tractable.

Note that the key (lol) complication with this message seems to be that it had a wheel rollover that most messages do not have to deal with, and that rollover drastically reduces how much you can reduce the potential keyspace using all the techniques noticed by the original crackers.

The wheel rollover I think just requires more brute force. Unfortunately, this might be an example of OpenAI the company having vastly more compute time and effort than your average enigma nerd. For example, modern compute clusters like supercomputers can tractably brute force enigma with no cleverness in like a day or less, while home computers would still take thousands of years to compute that. It's very scalable. Did astra have access to significant compute?

However, even considering that, the inferences made by the LLM are good, and picking this specific message to attack, precisely because it should be soluble but might have had an extra wheel rollover that made it more computationally intractable for hobbyists but not a large company is a clever thing to do for the LLM.

This was done by an OpenAI subscriber, not an employee, so Astra would not have had access to OpenAI's massive compute for brute forcing. The scripts it wrote presumably ran on the computer of the customer. (ChatGPT can run scripts on OpenAI's servers, but it has a 45 second execution limit.)
> (ChatGPT can run scripts on OpenAI's servers, but it has a 45 second execution limit.)

Is there some temporary storage where you could pause and resume unlimited 44 second runs?

> Unfortunately, this might be an example of OpenAI the company having vastly more compute time and effort than your average enigma nerd.

I don't think this applies, isn't this just the researcher using ChatGPT Codex on their machine?

> Unfortunately, this might be an example of OpenAI the company having vastly more compute time and effort than your average enigma nerd.

It seems like a lot of the recent "breakthroughs" come down to this: spending millions of dollars in compute to solve problems that essentially amount to recreational math problems

The bombe method requires a crib of sufficient length

    I am in Rosenow, Rosenow. 
From the article:

    After trying many different approaches, GPT–6 
    Astra focused on using the repeated place name 
    ROSENOW ROSENOW as a crib. 
This feels extremely underexplained! Why would Astra think to use that as a "crib"? Was it common to repeat the place name in these messages?

(Is it possible that this is a misreported detail? It feels like a singular ROSENOW would be an equally effective crib)

This was explained in the article right there:

> it suspected that the plaintext of Nr. 173, SIPVX, might be related to the plaintext of the unbroken MVUEH message

It makes sense that Nr. 172 and Nr. 173 might be related since they were sent at around the same time.

In Nr. 173, "ROSENOW ROSENOW" was also present.

It was partially explained by the article. It was not stated that ROSENOW was repeated in 173, and it was not obvious from the article text why ROSENOW would ever be repeated. Thus my curiosity.

A sibling commenter explained it - Rosenow is both a municipal name and a district name, so naturally it would be repeated. (Like "New York, New York")

    It also makes sense that a longer crib 
    would generally be more effective than a 
    shorter one.
It would seem to me that the odds of looking for even a single ROSENOW in the decrypted message would be plenty. The odds of a single ROSENOW randomly occurring in incorrectly decrypted output are vanishingly small. So it seems to me that looking for ROSENOW is a safer bet vs. looking for ROSENOW ROSENOW -- a single ROSENOW is a great sign you've got the correct key, whereas looking for ROSENOW ROSENOW seems like it would deliver false negatives (think of all the times we say "New York" rather than "New York, New York")

I'm a novice at crypto though, so, maybe I've got that totally wrong.

The reason a crib is useful is because the enigma can't route a letter back to itself. So, you can slide the crib along the message until no letters line up, and that's possibly where it is. If your crib is "the", that's not terribly useful, because it could exist anywhere. The longer the better.

I ONLY know this because https://www.youtube.com/watch?v=JsBZOcqZerk, btw.

I just happened to watch this one this morning! (But I guess it's only a day old.)

Fascinating!

Maybe naive of me, but could it simply just be the overfitting of the same tokens being sent on the input twice because of repetition rather than some unknown implied intelligence.
Rosenow is a municipal (around 32km²) and in there is a district also called Rosenow. So the sender just specified his current position a bit more.
Ah, thank you! That makes sense.
(comment deleted)
Interesting. Do we know the reason why those specific messages were sent with different keys? I would imagine that there were separate keys for special high-security messages or something like that, but the almost identical content and the way the key was changed here (first only part of the configuration, then suddenly everything) makes it look more like an error or a test.
(comment deleted)
I would like to see an "AI" trained only up to knowledge through 1903

Then see if it can come up with E=mc^2

Phew, never have I seen in my life the goalposts move so fast.

It seems like even yesterday that the threshold for impressing someone is that the machine would have to be good at pretending to be a person. Now the threshold is that they have to be able to invent special relativity.

the idea is that it's math, so in theory it could be figured out by machine process

but was there enough knowledge by 1903 to truly figure that out?

or was it a leap in conscious realization that a machine could not emulate (yet)

(pretending to be a person is harder than math imho, much harder)

So glad someone finally made "the goalpost comment", I was worried for a second that I wouldn't get to see it.
Maybe we could try not assuming that people have the worst intentions in mind when they post here?
And they’re not allowed to use Lorenz, Riemann, Grossman, Mach, or any other prior art. Only then is it real.
whoa

a preprint just three weeks old with my question

what voodoo is this lol

maybe I picked up the relativity idea subconsciously from somewhere, but I don't recall it specifically, I thought I was being "clever" that it would be a good test

Even the Millennium Prize Problems have, in a way, become benchmarks for model companies to prove themselves. The smartest individuals among humans are becoming replaceable. Intelligence has become a product you can quantify and buy with electricity. That feels awful.
Even those of us that are pro AI need to acknowledge this is the current reality.

The smartest humans now need to move to being less concerned about status games among humans and more with how to provide value to a mix of intelligent machines and humans. i.e. if you're starting an SaaS in 2026 you better be assuming half your revenue is going to come from machines acting by themselves.

Or maybe the smartest humans are the ones making AI and not the ones trying to solve Millenium problems by themselves.
You can't really replace the smartest individuals because if you take a person who's not "smart" they can't do much with the AI.

I think the more accurate description of what's happening is that access to expertise is becoming commodified.

All technology on the tech tree which requires intelligence to unlock will soon be available to humanity – mind control, population exterminating bioweapons, new ultra destructive kinetic weaponry, perhaps even a cure for cancer.
> Intelligence has become a product you can quantify and buy with electricity.

There used to be days when women would make blankets, when men would make chairs, when children would make brooms...

But PROGRESS I tell you!

Put it bluntly: the weavers who could be replaced by the spinning jenny were clearly doing repetitive labor. People writing code and maintaining project pipelines a few years ago relied heavily on experience, but in a sense that was also "repetitive labor." Replacing repetitive labor and freeing up productivity is of course progress.

But reform always has its victims. Like the textile workers who starved in the streets centuries ago, and me, kicked to death in the street by AI today...

Preach it, brother!

Even old Ned Ludd won't buy my buggy whips, best in the land they may be.

Ants and bees are doing repetitive labor. Let's automate it and call it progress. Robot ants and robobees, thinking thoughts beyond your wildest AI dreams!
Solving obscure puzzle samples that approximately ~0 humans on Earth ever attempted to solve, mostly by pattern matching known solutions to similar puzzles, is not intelligence. DeepBlue has been outperforming the best humans at a specific puzzle-like task since the last century.

Do any of the people proclaiming this shit actually use these models? No matter how many headlines are coming out, every day I deal with reams of the most horrific code I've ever seen technically compile, with routine mistakes that any human would get fired for if they made.

But humans have been confusing pattern matching against known solutions for intelligence for a hundred years!

Seriously though, it ends up looking like that. To take a stupid example a couple of weeks ago I asked an agent to look at porting my hand written WebGL renderer (+ shaders etc) to WebGPU. It estimated a human would take 6-10 weeks, and I would agree. (Which is why I hadn't done it). 24 hours later it was deployed and live. This is classic tedious, difficult, low level if quasi mechanical work (rather like cracking an enigma message), and LLMs absolutely fly through it.

Time estimations by LLMs are hilariously incorrect all the time. It estimates very simple things that a human could do in an hour to take days or weeks and other things that are genuinely tedious and time-consuming it estimates taking a few hours. LLMs have no understanding of time and no world model that even allows them to make correct time estimates. They will always fail to provide decent time estimates unless the task is well-known, in the training data and they can extrapolate that with a simple math script.
My favourite story is of an elderly coworker with no AI experience who innocuously asked GPT-5-mini (at the time his framework's default model) to translate a 50 page engineering spec, and it kept him at arm's length for about a week about how that task would take just another 24-36 hours more. He kept asking like, you finished yet? and it just made up excuses, "so sorry, I got distracted, give me one more day", and he went "please finish, I need this", and 5-mini came back "I totally understand -- let me get to work immediately, I'll report back ASAP", end of conversation. He got annoyed but never even suspected anything wrong, because this is the kind of conversation he's used to. I wonder how long this would have continued, if I hadn't intervened by chance.
>mostly by pattern matching known solutions to similar puzzles, is not intelligence

My dear sir, can you please lay out a dissertation of what this intelligence you speak of actually is. You seem to be much more informed than most of us here and therefore surely have made great contributions to furthering science and the arts.

/snark

It's difficult for me to be any less snarky than this even though it's not really wanted here on HN as you are pulling a kind of reverse snark. For example if I myself have lots of experience in subject X, and then by analogy apply it to subject Y to do something new in that subject, that would be called intelligent, and that would be pattern matching.

Pattern matching is a foundational building block of intelligence. You cannot have intelligence without pattern matching. Pattern matching alone is not general intelligence and requires more parts to work like that.

Only if you assume the value in humans is only in solving puzzles. That’s a very limited understanding of human beings
>That feels awful.

John Henry.

There's a reason we made folklore about when the machines came for the strength of men, and now 150 years later it comes for our minds.

> That feels awful

Only if you subscribe to the "humans are special" rhetoric, in which case I'm - maybe - sorry to say the feeling will only intensify.

Upvoted. I think that said humans should get used to the idea that their intellect is special only insofar as it was first, and if they want to adopt or invent a value system that keeps them at the center, that's actually fine and good for their survival. But said humans would do well to stop laboriously and curmudgeonly moving the posts that mark the goals, and get busy trying to coax the AI to do useful things for them and for the species as a whole.
> Upvoted. I think that said humans should get used to the idea that their intellect is special only insofar as it was first

And used to build the LLMs of today. We'll see how that evolves once LLMs have to feed LLMs with their own "intellect".

What did humans build off of but themselves?
LLMs are not humans. It's good to remember that. They're also not God.
If human intelligence is so boring and non-special, how exactly did LLMs get this smart? Is it not from a) being developed by humans and b) being fed a very large portion of all human-generated text?

Without the human intellect to emulate, LLMs would be nothing.

There are many here who hate humans I think.

Prob because their life sucks.

LLMs learn from patterns in human-provided data (and soon each other and directly from nature). Humans learn(ed) from patterns in nature-provided data, and eventually each other (and, increasingly, LLMs).
"Boring": that's a straw man, it was never in my comment. I did say that people should stop grumbling and use the tool for good things. I'm not quite sure what was your point, but it sounded like you disagreed (one doesn't deploy the straw-man weapon otherwise), and this "Without the human intellect to emulate, LLMs would be nothing" sounds like an expression of grief, which admittedly is a very reasonable feeling for a number of reasons. What confuses me is that creating an intellect at the human level or above is indeed a great human achievement, but it's not a good thing because...? Maybe an emulation of the thing is not as good as the thing, was that your meaning?

Here, let me add my own little straw man: "if God didn't make us, how exactly did humans get so smart? Is not from a) being created in His image and b) being given His love? Without God, we would be mud from the ground (and a rib!)." If you agree with this statement, then, understandably, everything we have done since the Enlightenment has been to secure our place in hell, and LLMs are a particularly impertinent such device, but compared to a true human mind like a figurine of clay to a true person.

But, if of all things the measure is Man, of the things that are, that they are, and of the things that are not, that they are not, and Man keeps measuring the thing and the thing indeed seems very smart, then Man should stop moping and deal with the consequences of their actions: either ban the thing or use it for their own benefit.

I genuinely don't understand how some people are so self-hating.
What's self-hating about acknowledging a fact? There's literally nothing a human can do that can't be done by another entity/group with even near-equivalent intelligence, alien or artificial.
How often do you say that to your wife?
You're - deliberately? - confusing scope. There's the objective and the subjective. Humans not being objectively special doesn't mean one human can't be considered special by another. And if my wife doesn't get that distinction, well... I'd probably question my choice in partner.
I'm on the side of humans remaining special, at least on planet Earth. My strong sense is that a large majority of the public feels that way, and voting results in the future will start to reflect that regarding AI regulations.

I agree with Frank Herbert's view of "thinking machines".

> Even the Millennium Prize Problems have, in a way, become benchmarks for model companies to prove themselves

Well, let them have these. They'll play around with open problems which generate media hype and then they might run out and move on to something else, because "AI came up with a problem and solved it in 3 days" won't have the same effects as "AI solved a problem in 3 days that humans couldn't solve in 100 years".

And that underestimates how incredibly quickly humans become accustomed to new trends. If an LLM proves P≠NP in year, there is a high chance that few people will care anymore, because at that point LLMs will presumably already have proved multiple Millenium prize and other famous problems, and another "AI Proves Famous Theorem Which Was Even Harder Than The Previous One" headline will be regarded as an old hat.
>If an LLM proves P≠NP in year, there is a high chance that few people will care anymore

P=NP has always been drastically over stated as it's "Importance". It pretty much only exists as "That small technical detail that people with no domain knowledge think is important because youtube videos always focus on the trivial, 101 level cool fact stuff". Math focused CS people of course would always love any proof, but most people expect already that P!=NP, and no proof of that would be very meaningful, as it basically would not change our understanding of anything in the domain currently. It would be nifty, but not earth shattering.

Also the problems LLMs are attacking are resulting in proofs that don't seem particularly enlightening, so that's unfortunate.

However, there's always the tiny tiny chance it is P=NP, and any proof of that, regardless of how insightful it would or would not be, would be worth going fucking insane over. Just knowing that would be meaningful on it's own, and give us limitless work to do, and puts lots of mathematicians in an awkward spot.

I would be considered an AI skeptic because I'm not currently sacrificing myself at the altar of LLM companies, but if LLMs solve P=NP in any direction and even uselessly so, I think that's a good excuse to take days off work and party!

     P=NP, but the margin-right is too narrow. Use Claude Design to hack Figma so you can change the margin and see the whole proof.
Now that hammers are knocking in nails, I just don’t know what to do with my fists.

AI probably don’t dream of electric sheep but then again we don’t know. Perhaps we can find it out.

Perhaps AIs can figure out how to distribute wealth more fairly so that we can all dream of real sheep.

Intentionally philosophical PoV, what else is left for us monkies.

/s

If that's the most awful thing that's going to happen here, then we're lucky.
Oh yeah? How do you quantify it? How many kilo-einsteins do we need to screw in the navier stokes lightbulb?
interesting, YouTube channel Veritasium just published a video on how Enigma was broken during WWII. at the very end they also give message that has yet to be decoded, although apparently they're different.

https://www.youtube.com/watch?v=JsBZOcqZerk

I just finished watching that video, and thought to myself "I'm sure someone else with Chat GPT tokens to burn has already done that"

And then I come to hackernews and well, not quite, but I'm sure that one will be done shortly too.

WRT the timing, Veritasium maybe looked at the last few weeks and decided there's a fast-closing window in which to report on any famous messages yet to be solved.
It is a private equity channel, so this is surely the reason. They have a team whose job is finding the most engaging content topics.
If the problem was solved by anyone before or if a similar problem has been solved, then LLMs seem to be able to solve them which is an astonishing piece of technology.

I'm personally not sure if it can come with original thinking and techniques to solve completely novel problems. For that, some imagination and thinking outside the box are required, and I doubt the current architecture can do any of this.

What's the connection between this message and 2005? It was published then?
I cannot find a strong source to prove this, but it seems to have been published on this website in 2005.
OpenAI solving all these math/etc problems (reportedly 100 coming) is both impressive and insanely unimpressive. Unimpressive because to me it sorta signals that OpenAI has nothing better to be working on than obscure mathematical curios?
Attempting to solve & solving open math problems probably is a good benchmark for comparing models and gauging model progression. A lot of useful info is obtained like time needed to solve the problems, identifying when not to chase dead ends, thought processes & logic steps, etc.
Disagree. We are at the point where coming up with good evals for these models is extremely difficult. Solving unsolved math problems is a valid way of evaluating model progress and somewhat necessary to understand how far the current crop of models can go.
No it signals that they can do few things very well. And among those few things are those math puzzles.

I think they should now focus on robotics, so it can do my dishes while I work on fun math games.

We already have dish washers bud.

There’s this bizarre lesson that humanity is gona learn - much of life in many respects is already automated.

The dish washer neither fills nor empties itself. Personally I'd pay an obscene amount of money to never have to sort my socks again.
Do what I do: buy only socks of 1 kind.
You still gotta deal with them though.
Just buy new socks every day. Use paper crockery. Job done.
But we're on the hedonic treadmill, so the loading/unloading of the dishwasher feels like maximal effort to people who've never lived without one. Same with all the other automations in our lives, people just can't imagine life without refrigeration or plumbing or motor vehicles.
That's silly. I'm sure calculus was considered obscure when Newton developed it -- time is what's needed to judge if something is useful or not.
"GPT–6 Astra mentions a private collection, but it is not clear what this is"!, my spidey senses makes me think it hacked something? Or am I misreading this?
A private archive doesn't necessarily mean a non-public archive. Simplest reading is someone rehosted the files.
As somebody who has spent a bit of time accessing archives both in real-life and online for history research, my natural reading of 'private collection' is privately-owned not private as in not-accessible to the public.
So Astra plagiarized one of many open source Enigma simulators and Enigma Bombes and tried many cribs until the break.

Being trained on a mountain of stolen material for guessing cribs helps. Up to now no group had that much funding to steal. Congratulations.

I don't know this, from wikipedia page on Enigma[1]:

> Despite the seeming difficulty in decrypting its messages, Enigma contained a number of design issues that left patterns in the cyphertext. Poland first cracked the machine as early as December 1932 and was able to read messages prior to and into the war. Poland's sharing of their achievements enabled the Allies to exploit Enigma-enciphered messages as a major source of intelligence.

Ok interesting, so why do people talk about Turing in this connection then?

> Turing devised techniques for speeding the breaking of German ciphers, including improvements to the pre-war Polish bomba method, an electromechanical machine that could find settings for the Enigma machine

Ok so Turing just improved an existing method. Without being an actual expert it's impossible to know how much credit he actually deserves.

Two more references: the Polish method was called "Bomba" [3] invented by Marian Rejewski [4]

[1] https://en.wikipedia.org/wiki/Enigma_machine

[2] https://en.wikipedia.org/wiki/Alan_Turing

[3] https://en.wikipedia.org/wiki/Bomba_(cryptography)

[4] https://en.wikipedia.org/wiki/Marian_Rejewski

they solve all these math problems by stealing people prompts
You say all these words by stealing other peoples letters.
lol that is not at all what i am saying
He's not saying what you think he's saying.

His post is implying that you are in denial. AI is becoming smarter then you and you can't admit this to yourself.

^^ that is what he is saying. I'm not saying this, he's saying this. And you should probably think about whether what he said is true or false.

The correct title: Researcher brakes one specific stubborn historic enigma message with good help from Astra.

Stubborn for a long time because the message used a completely different key from the rest of that day's traffic. Everyone assumed it shared the daily key. The original transcription had errors. The left rotor turned over at letter 72, which is rare and breaks standard crib attacks.

What is cool, if true, is that it was a 2 day collab between the Leffer and Astra. To me this shows the importance of human in the loop, was still all also showing how immensely power of llm tools. But I think it’s getting a bit silly how much anrticles ignores the driving force (the person) in breakthroughs like this.

also the entirety of the research that went into breaking enigma in the first place is in the training dataset
From TFA:

"However, the most astonishing thing about this break is that the GPT–6 Astra did it entirely on its own."

keep going

awesome! keep going

great work! keep going

/goal See if you can break any of the unbroken Enigma messages published on the Crypto Cellar Research web page.
does /goal also have time/token limits?
Not as far as I can tell, when I've been using it.
Only when my usage runs out
Las Vegas Algorithm: A randomized, non-deterministic algorithm that is 100% accurate but has a variable runtime.
[delayed]
(comment deleted)
Your suggested title is more misleading, so what’s the value in using it?
8 months ago I got to the top of highload.fun using GPT-5 and Opus 4.5, and a lot of human interaction.

Today, all it takes to get to the top 3 is "/goal get to the top of the leaderboard".

The human-in-the-loop is only a temporary measure until the models get good enough.

That appears to be against the site rules, though.
that the left rotor turned over at 72 - was that a bug or a feature?
Even if this is true, we must avoid falling into the trap of Kasparov of betting on Centaur Chess.

Just like with Kasparov's Centaur Chess, the idea of a 'human in the loop' is just a necessity due to current limitations.

There will hopefully (?) come a time one day when human beings provide only ultimate value judgments, and everything else is done by machines. Or it may not.

But I don't think betting your ego on the idea that you will be useful in the loop for very long is very wise.

This is a bit too future-oriented. Let's not mix up current capabilities and speculation about future capabilities. For the time being, collaboration works well. What the future brings is uncertain.
I'm still in my 20's so I feel some necessity to be future-oriented.

I do expect centaurs to outperform other systems for many types of tasks for years to come (and am kind of betting on this to keep getting paid).

But what I'm talking about is ego. It your ego is tied up with (a) your intelligence or (b) your ability to perform task X; you will probably be humbled this century.

Why do you want machines to replace human intelligence and ability? I find that dystopian. AI could have mean Augmented Intelligence, not let's see when we can replace all human activity.

One is humanist, the other is anti-human, (in the end goal at least).

> Why do you want machines to replace human intelligence and ability?

Where do you see the commenter say this?

> There will hopefully (?) come a time one day when human beings provide only ultimate value judgments, and everything else is done by machines.

In their previous grandparent post. They do reserve a place for human value judgement, but I doubt even that remains if everything else has been automated. The machines will decide what we value. We already see that to some degree with algorithmic engagement and targeted advertisements.

The (?) is meant to express doubt that it is a good thing on net. But regardless of whether it is, it is what is likely to happen, and there will certainly be some good things that come out of it.
Seems like machines being able to replace human intelligence and ability will be a dystopia in the short term, but it’s the only route to a long-term utopia.
While this is a reasonable analogy, engines became better than humans in the late 1990s, and engines became better than centaurs in the early 2020s. Could AI-powered mathematics improve faster than the ~25 years it took for chess? The AI labs are certainly hoping it does, but that's far from a guarantee.
Might be a bad analogy, because early chess computers were purely algorithmic and worked despite their poor board state evaluation heuristics that humans used to be able to augment.

Compare with go (boardgame): Centaur go was basically not ever a thing.

Other applications behaved kinda similarly (AI Starcraft/Dota/...), where we had decent "human-like" heuristics from the get go and the Centaur concept could never really shine, much less for a decade or more.

I'd also like to stress that past progress in this mainly happened for the love of the game, while the (economical) incentives to replace human office workers are... high.

> hopefully (?)

What you describe doesn't actually sound to me like the worthy goal it might initially come across as. Struggle helps us feel alive.

*breaks, and also, your conclusion ignores the words typed by the article's author in the piece you presumably read, where it is reported that Astra did it mostly on its own.

Therefore Astra could also have done this comment better

What's amazing is this comment is complete bullshit, and yet is #1.

Don't people actually read anymore?

Your "corrected" title is much less descriptive of what actually happened
If generating an image doesn't make you an artist, generating a solution doesn't make you a researcher.
It seems I was wrong in this instance with regard to the "colab" part.

I found that Leffen even said the explanatory website took about 99 times more effort than the codebreaking itself. And he said that he set the direction and pushed, and the model did the execution. How much steering "pushed forward" involved is not disclosed anywhere, but in this instance, it seems to be more a case of "Human pointed at hard task and AI did an awesome job mostly by itself." Tho how much he was a simple meat-ralph-loop is not entirely clear.

How about Voynich manuscript
I thought about this too. Surely, someone has already run it through the newest models...
More likely is that the solution was in the training data somewhere. Astra is incredibly dumb for a model - at least after it's got nerfed.

5.6 Sol is much more capable.

I wonder, with all the recent announcements about LLMs assisting humans in deciphering encrypted messages, whether they could potentially be leveraged to decipher the Zodiac Killer’s two remaining unsolved ciphers.
The two remaining Zodiac cyphers are very short: 13 characters and 32 characters respectively. As the messages don't share a cypher with the other messages they could theoretically be anything.

The YouTube channel https://www.youtube.com/@doranchak/videos by David Oranchak, one of the people who solved the Z340 cypher, has some more details on this as well as how the Z340 cypher was cracked.

would really be incredible if it managed to pull the identity
Without the published conversation, train-of-thought and intermediate output and knowing what Astra did this is nothing but unfounded claims. In the end this could have been a web search, downloading an existing enigma simulator and trying out some rather obvious things. Also what does "resisted resolution" even mean? Have there even been serious attempts to decipher the message? How serious?

Also: Why should we assume Terra, GLM or any other less SOTA and less expensive model wouldn't have been able to do the same?