I would put Apple updates in that bloatware category given I was forced to upgrade my phone after iOS and updates eventually took up 50% of storage.
I'm not sure it's the niche or targeting problem. I think we're getting games with flat out fewer features and smaller scope than earlier entries in the series because _so_ much energy is disproportionately put into…
I think Andromeda was actually more of a victim of modern "outrage" culture. A few bugs, memes, and suddenly a game is "trash". The game wasn't terrible and I recall enjoying playing it at the time. Sure, some of the…
To echo this, this is where Astra begins to stand out as a larger model and Opus begins to show certain cracks. I find Astra more adaptive, even as Opus is more capable in most coding/execution/tool-use domains.…
Good point. On that note, it may be a bug but I noticed Argon compacting well under the 1M max in Copilot (around 400k) -- when set to 1M context. That may be a Copilot thing but I've never seen that with other models…
I was a game developer for many years, at large scale (MMO) and at small scale (indie). With the advent of AI, I've been _trying_ to use AI to accelerate game development and have come to a few conclusions. 1. AI models…
Multiple things can be correct at the same time. OpenAI needs to improve AI Safety --- OpenAI Employees have a responsibility to retain corporate secrets and do not have blanket freedom to share with 3rd parties. Their…
Forgive me but this feels like the same as AI coding and AI art arguments. I don't understand why it's a more special case that needs special attention. AI comes for the interesting, the livelihood and people either…
Your post made me wonder if Artificial Analysis had finally moved to TB4 and lo and behold they have and Astra is tied with Fable 5.1 at 53. That then made me realize that they lower the bars of tied scores so on the…
I have not experienced this (yet) but I have with models in the past. I think it's important to have a solid benchmark where you KNOW there's a difference in model performance. I have one around 3D modeling that models…
Great site, triggered memories! haha. To try to add something to this discussion -- I think that while I've seen these sort of loops less --- what I have seen is "overly helpful". Models nowadays want to…
I don't think this is quite true. We have other examples. Fable is without question the larger and more thoughtful/intelligent model. It also gets out performed by Opus on many/most benchmarks. So we can say that while…
I suspect this is "no reasoning set" which might be "default: medium" or perhaps some smart routing. I don't think it's literally "no reasoning".
Honestly, it's platform dependent and "OK" at best, "Mediocre" at worst (Agy on Windows). Gemini is great via the Chat interface and decent via Github Copilot. I honestly hate it via Antigravity CLI because their…
You are re-compressing information that is in-effect meaningless because it's all decompression artifacts. The AI had a nugget of data and decompressed that into a flood of text. The exhausting thing is that we're then…
It would make reading and comparing a bit easier if the data was sorted by a dimension.
That's a good point and something I encountered yesterday. On a multi-agent task, Gemini was the only model that got near the end, ran tests, saw it had issues, took a screenshot, saw the issues, and then said, "I'll…
I want to like Gemini models but my problem thus far has been a lack of coding chops. They still make mistakes, importantly, without correcting them for things like hallucinated API calls or code that doesn't run but…
My experience has been a difference between "applied intelligence" and "breadth of intelligence". Fable is the theoretical computer scientist while Opus is the Staff engineer who will implement it. I find that Opus has…
Grok is quite interesting. I run comparisons almost daily on tasks and Grok is its own beast, in a good way. It's good to have model diversity. When I run a task across Sol, Terra, and Luna, I get variations of the same…
[flagged]
I think most of the comments in this thread are missing the point. It's not about whether it's legal/ethical/etc. It's about the narrative that "Chinese models are at Fable level". The truth (if correct) is the China…
You should really provide more on your methodology because as it stands, it really doesn't pass the sniff test. GPT-5.6 Sol on Low beats Fable Medium by 10% and Gemini-3.6 Flash then beats them both? Fable is number 20?…
This is a perpetual pet peeve of mine with LLMs. They will always opt to ensure "backwards compatibility" with a codebase built 30 seconds ago. I always have to explicitly state, "we are making a clean break to v1.0, do…
I would put Apple updates in that bloatware category given I was forced to upgrade my phone after iOS and updates eventually took up 50% of storage.
I'm not sure it's the niche or targeting problem. I think we're getting games with flat out fewer features and smaller scope than earlier entries in the series because _so_ much energy is disproportionately put into…
I think Andromeda was actually more of a victim of modern "outrage" culture. A few bugs, memes, and suddenly a game is "trash". The game wasn't terrible and I recall enjoying playing it at the time. Sure, some of the…
To echo this, this is where Astra begins to stand out as a larger model and Opus begins to show certain cracks. I find Astra more adaptive, even as Opus is more capable in most coding/execution/tool-use domains.…
Good point. On that note, it may be a bug but I noticed Argon compacting well under the 1M max in Copilot (around 400k) -- when set to 1M context. That may be a Copilot thing but I've never seen that with other models…
I was a game developer for many years, at large scale (MMO) and at small scale (indie). With the advent of AI, I've been _trying_ to use AI to accelerate game development and have come to a few conclusions. 1. AI models…
Multiple things can be correct at the same time. OpenAI needs to improve AI Safety --- OpenAI Employees have a responsibility to retain corporate secrets and do not have blanket freedom to share with 3rd parties. Their…
Forgive me but this feels like the same as AI coding and AI art arguments. I don't understand why it's a more special case that needs special attention. AI comes for the interesting, the livelihood and people either…
Your post made me wonder if Artificial Analysis had finally moved to TB4 and lo and behold they have and Astra is tied with Fable 5.1 at 53. That then made me realize that they lower the bars of tied scores so on the…
I have not experienced this (yet) but I have with models in the past. I think it's important to have a solid benchmark where you KNOW there's a difference in model performance. I have one around 3D modeling that models…
Great site, triggered memories! haha. To try to add something to this discussion -- I think that while I've seen these sort of loops less --- what I have seen is "overly helpful". Models nowadays want to…
I don't think this is quite true. We have other examples. Fable is without question the larger and more thoughtful/intelligent model. It also gets out performed by Opus on many/most benchmarks. So we can say that while…
I suspect this is "no reasoning set" which might be "default: medium" or perhaps some smart routing. I don't think it's literally "no reasoning".
Honestly, it's platform dependent and "OK" at best, "Mediocre" at worst (Agy on Windows). Gemini is great via the Chat interface and decent via Github Copilot. I honestly hate it via Antigravity CLI because their…
You are re-compressing information that is in-effect meaningless because it's all decompression artifacts. The AI had a nugget of data and decompressed that into a flood of text. The exhausting thing is that we're then…
It would make reading and comparing a bit easier if the data was sorted by a dimension.
That's a good point and something I encountered yesterday. On a multi-agent task, Gemini was the only model that got near the end, ran tests, saw it had issues, took a screenshot, saw the issues, and then said, "I'll…
I want to like Gemini models but my problem thus far has been a lack of coding chops. They still make mistakes, importantly, without correcting them for things like hallucinated API calls or code that doesn't run but…
My experience has been a difference between "applied intelligence" and "breadth of intelligence". Fable is the theoretical computer scientist while Opus is the Staff engineer who will implement it. I find that Opus has…
Grok is quite interesting. I run comparisons almost daily on tasks and Grok is its own beast, in a good way. It's good to have model diversity. When I run a task across Sol, Terra, and Luna, I get variations of the same…
[flagged]
[flagged]
I think most of the comments in this thread are missing the point. It's not about whether it's legal/ethical/etc. It's about the narrative that "Chinese models are at Fable level". The truth (if correct) is the China…
You should really provide more on your methodology because as it stands, it really doesn't pass the sniff test. GPT-5.6 Sol on Low beats Fable Medium by 10% and Gemini-3.6 Flash then beats them both? Fable is number 20?…
This is a perpetual pet peeve of mine with LLMs. They will always opt to ensure "backwards compatibility" with a codebase built 30 seconds ago. I always have to explicitly state, "we are making a clean break to v1.0, do…