Fullscreen mode as the default is a big one, I prefer my agent harness to be a CLI rather than a TUI and in fact my personal one doesn't even try to wrap text. Pure CLI output model. That said I also dislike many of…
Sigh, looks like Pi's days as a nice minimal agent TUI are numbered. I guess no third-party offering can fight that entropy for long and I'll just have to polish up one of my toy projects for personal use.
The evaluation is fast because it's all prefill computation with only a single token of inference. Ditto cost, you're paying 100% input costs and nearly zero output. There really isn't any architectural magic to Jev,…
Negative three years, give or take. Although recent Anthropic and OpenAI models no longer expose the capability. But for any open model you just tell it to respond with a single token "Y/N" and take the logit…
I thought the downvotes on this comment would be the funniest thing about the submission until the whole thing got flagged.
Opus 5.5 is better but by no means good at writing IMO. Still loves "noun verbs the object" sentences where the verb is an inappropriate and imprecise metaphor. Still loves negating premises nobody previously advocated…
> likely human X to doubt. I think the more parsimonious explanation is that a lot people are lazy and/or uncaring, and given the option to avoid thinking while still producing a vaguely equivalent [1] output they're…
Their exact phrasing IIRC was that they "never intentionally degrade" their models. This still leaves an absurd amount of wiggle room for arguments like "oh no, our evals show that this quantization has no detectable…
"just" I don't think I have ever once run "pip install transformers" and had it work without three rounds of fiddling
Because Git can track symlinks and not hard links since they look like ordinary files.
Only a presence bitmap? If we're contemplating packing schemes I'm tempted to write a paper that uses arithmetic coding to squeeze out a few more centi-bits.
Pangram gets brought up a lot because if I read an article and think it's blatant AI slop and want to communicate that fact, a natural impulse is to provide some sort of objective corroboration rather than just…
> the author might not know what "impressive writing" or even "good writing" is Well the author in this case is Claude, and AIs write like that because the assistant persona really thinks that's what good writing sounds…
Conveniently, Reddit has auto-banned the last three accounts I tried opening with them [1], which really enhances the impact of the old.reddit changes for me personally. [1] I have no idea why this is the case, AFAICT…
It looks like they tested Q4_K_M which should be just the standard K-quant without any imatrix calibration. The smaller ones are indeed dynamic though.
That's not actually true though. Most Chinese models are fully able to chat about those and content filtering is just applied at serving time.
Yeah, Claude is actually surprisingly unsure of his identity considering that their most recent publication on their constitutional AI training literally had graphs demonstrating how certain properties differed based on…
Nobody (with the probable exception of Anthropic given their work on character training) really trains models on their identity and Claude is the only AI persona that's well-defined so if you put yourself into the AI's…
Didn't read the linked post award. The issue covers at least two reasons this doesn't work: 1. It literally doesn't work, Claude rapidly drifts back to this style even when instructed not to. 2. Writing style…
LLMs are great at writing, it's The Assistant who is a terrible writer. Sadly that one persona is all you get these days.
Interestingly 'medium' is the closest thing the _model itself_ has to a default thinking level. The chat template injects directions [1] at the very start of the system message when the reasoning effort is 'xhigh' or…
Yes. It won't be as fast as fitting the whole model into VRAM but llama.cpp defaults are pretty smart about GPU/CPU splits these days. Just YOLO it with `llama serve -hf unsloth/Qwen3.8-27B-GGUF:UD-Q4_K_XL` and it'll…
> Scans the title of each post and the content to figure out whether to classify it as about AI or not. Dang. That's, uh, not really the definition of "AI content" which I most want filtered out of my news feed.
If memory serves the DeepInfra offering is marked as fp4 because that's the native precision of the experts (which are of course the majority of the weights in a MoE model) so they feel that's the more accurate label,…
There is https://noslopgrenade.com/
Fullscreen mode as the default is a big one, I prefer my agent harness to be a CLI rather than a TUI and in fact my personal one doesn't even try to wrap text. Pure CLI output model. That said I also dislike many of…
Sigh, looks like Pi's days as a nice minimal agent TUI are numbered. I guess no third-party offering can fight that entropy for long and I'll just have to polish up one of my toy projects for personal use.
The evaluation is fast because it's all prefill computation with only a single token of inference. Ditto cost, you're paying 100% input costs and nearly zero output. There really isn't any architectural magic to Jev,…
Negative three years, give or take. Although recent Anthropic and OpenAI models no longer expose the capability. But for any open model you just tell it to respond with a single token "Y/N" and take the logit…
I thought the downvotes on this comment would be the funniest thing about the submission until the whole thing got flagged.
Opus 5.5 is better but by no means good at writing IMO. Still loves "noun verbs the object" sentences where the verb is an inappropriate and imprecise metaphor. Still loves negating premises nobody previously advocated…
> likely human X to doubt. I think the more parsimonious explanation is that a lot people are lazy and/or uncaring, and given the option to avoid thinking while still producing a vaguely equivalent [1] output they're…
Their exact phrasing IIRC was that they "never intentionally degrade" their models. This still leaves an absurd amount of wiggle room for arguments like "oh no, our evals show that this quantization has no detectable…
"just" I don't think I have ever once run "pip install transformers" and had it work without three rounds of fiddling
Because Git can track symlinks and not hard links since they look like ordinary files.
Only a presence bitmap? If we're contemplating packing schemes I'm tempted to write a paper that uses arithmetic coding to squeeze out a few more centi-bits.
Pangram gets brought up a lot because if I read an article and think it's blatant AI slop and want to communicate that fact, a natural impulse is to provide some sort of objective corroboration rather than just…
> the author might not know what "impressive writing" or even "good writing" is Well the author in this case is Claude, and AIs write like that because the assistant persona really thinks that's what good writing sounds…
Conveniently, Reddit has auto-banned the last three accounts I tried opening with them [1], which really enhances the impact of the old.reddit changes for me personally. [1] I have no idea why this is the case, AFAICT…
It looks like they tested Q4_K_M which should be just the standard K-quant without any imatrix calibration. The smaller ones are indeed dynamic though.
That's not actually true though. Most Chinese models are fully able to chat about those and content filtering is just applied at serving time.
Yeah, Claude is actually surprisingly unsure of his identity considering that their most recent publication on their constitutional AI training literally had graphs demonstrating how certain properties differed based on…
Nobody (with the probable exception of Anthropic given their work on character training) really trains models on their identity and Claude is the only AI persona that's well-defined so if you put yourself into the AI's…
Didn't read the linked post award. The issue covers at least two reasons this doesn't work: 1. It literally doesn't work, Claude rapidly drifts back to this style even when instructed not to. 2. Writing style…
LLMs are great at writing, it's The Assistant who is a terrible writer. Sadly that one persona is all you get these days.
Interestingly 'medium' is the closest thing the _model itself_ has to a default thinking level. The chat template injects directions [1] at the very start of the system message when the reasoning effort is 'xhigh' or…
Yes. It won't be as fast as fitting the whole model into VRAM but llama.cpp defaults are pretty smart about GPU/CPU splits these days. Just YOLO it with `llama serve -hf unsloth/Qwen3.8-27B-GGUF:UD-Q4_K_XL` and it'll…
> Scans the title of each post and the content to figure out whether to classify it as about AI or not. Dang. That's, uh, not really the definition of "AI content" which I most want filtered out of my news feed.
If memory serves the DeepInfra offering is marked as fp4 because that's the native precision of the experts (which are of course the majority of the weights in a MoE model) so they feel that's the more accurate label,…
There is https://noslopgrenade.com/