I think people don’t do genuine benchmarks because the market forces them to pretend their solution works for anything you can throw AI at. Companies whose valuation is based on them being the…
Naively, I think some optimizations would require access to the whole codebase and that would make people nervous (plus incur more cost). Eg absurd idea, but you could write something that minifies a codebase (by token,…
I would guess they’ll spend ages arguing about what an “ad” is. Eg if I ask Llama 3 to find me the best headphones, I think we can agree its response isn’t an ad. If Claude responds with a banner that Sennheiser…
I’ve been looking along a similar line, but I came at it from the infra side rather than the software. Mine pretends to be a local ACP agent, but it’s actually managing a Docker container and proxying the ACP connection…
There’s a big gap between hobby self-hosting and enterprise. Clouds are appealing (note, not technically better but more appealing) in the enterprise for numerous reasons. We already have a contract, I don’t have to…
I'm not positing that as a moral good or bad. It's possible for stock market gambling to be bad for society but have better price discovery, in the same way that dictatorships are bad but tend to have faster response…
I've worked on both sides and I really think it comes down to Dunbar's number [1] and thus the size of the company. At a sufficiently small company, you can just trust people will generally do the right thing. I ask X…
The utility is always the same. The stock market provides price discovery, which drives efficient resource allocation (in theory). Theoretically, more gamblers should mean better price discovery because the payouts for…
Acetaminophen overdose does actually have a surprisingly high rate of occurrence. A lot of people don’t realize how narrow the therapeutic band is. Doubling your meds on a bad pain day can put you way beyond the safe…
When I messed with it I used Kagi's search and I didn't have that issue (not claiming they're the best, they're the only one I tried). They filter their results through their AI, though, so you get a sort of…
Sort of depends on how well the core reasoning works. It’s not a big effort to connect an LLM to a search provider. You do pay for the tokens, but in theory on a smaller model each token is cheaper.
That’s just two sides of the same coin. They run a proxy for LLM providers, which inevitably creates a marketplace. They’re amazon.com for tokens. The flip side that others are pointing out is that Amazon is sticky…
I don’t expect it to be exact or like code, but at the very least I expect it to be predictable and the “spirit of the law” fails that test often. I still remember GDPR coming out and I read til my head hurt, decided…
I would disagree with you, because "technical compliance" is compliance with the letter of the law. You have complied with every explicit requirement of the law. If the law is insufficient then legislature is free to…
Because it likely is, despite both their levity and the general lack of nuance in the CFAA. Quoted from 18 U.S.C. § 1030 (the CFAA) [1] (without quote blocks, because mobile): --- Start Quote (2) intentionally accesses…
I’ve bought some stuff off there and can tease out some aspects, though they may be after the fact rationalizations of subconscious effects. The first is price. The stuff is cheap, as in so cheap I know it will be…
It might just not be for you. I use OpenRouter because I do like being able to quickly check whether a new model works better, but mine is a “human in the loop” dev process so it won’t ruin a day of batch processing or…
It cost them more than normal food to maintain the stockpile. I’m not for profiteering but maintaining a stockpile implies excess production that spoils rather than being sold. It does seem fair to pay enough to cover…
I don’t think so because those both live in the context window and as such pollute it when they’re not performing optimally. I think having unused or rarely used weights doesn’t influence the results as poorly as RAG…
Do they do something neat with the colon? I do prefer the shorter keyword syntax, at least in Clojure because of how common they are. Clojure tends to use them very heavily though, and last I looked it seemed like…
I have little faith any of it would stop someone who was a) devoted, b) prepared, and c) had physical access for a reasonable time. It’s still worth doing because the vast, vast majority of people will fail at a or b…
The electricity company doesn’t have a contract that says they’ll only give electricity to specific people. Iron Mountain just doesn’t want to be in the middle, and I can see why. OSS went defunct, PBS files a lawsuit,…
Probably, but LLMs can’t execute code directly. They’d be making tool calls to make bash run ncat or curl or whatever that would be suspicious, as would any attempts to obfuscate it (“why is my agent doing an ‘eval…
Funnily enough, I would say almost the opposite. CC’s feature set is basically table stakes for an agent these days (does it have ACP yet? Very close to behind table stakes if not) and it has a lot of bloat powering…
I’m not endorsing the idea, but we could ban printing the card number on the card. New cards would only have a CVV, chip, mag strip and some way to differentiate between 2 cards from the same company (a colored dot?).…
I think people don’t do genuine benchmarks because the market forces them to pretend their solution works for anything you can throw AI at. Companies whose valuation is based on them being the…
Naively, I think some optimizations would require access to the whole codebase and that would make people nervous (plus incur more cost). Eg absurd idea, but you could write something that minifies a codebase (by token,…
I would guess they’ll spend ages arguing about what an “ad” is. Eg if I ask Llama 3 to find me the best headphones, I think we can agree its response isn’t an ad. If Claude responds with a banner that Sennheiser…
I’ve been looking along a similar line, but I came at it from the infra side rather than the software. Mine pretends to be a local ACP agent, but it’s actually managing a Docker container and proxying the ACP connection…
There’s a big gap between hobby self-hosting and enterprise. Clouds are appealing (note, not technically better but more appealing) in the enterprise for numerous reasons. We already have a contract, I don’t have to…
I'm not positing that as a moral good or bad. It's possible for stock market gambling to be bad for society but have better price discovery, in the same way that dictatorships are bad but tend to have faster response…
I've worked on both sides and I really think it comes down to Dunbar's number [1] and thus the size of the company. At a sufficiently small company, you can just trust people will generally do the right thing. I ask X…
The utility is always the same. The stock market provides price discovery, which drives efficient resource allocation (in theory). Theoretically, more gamblers should mean better price discovery because the payouts for…
Acetaminophen overdose does actually have a surprisingly high rate of occurrence. A lot of people don’t realize how narrow the therapeutic band is. Doubling your meds on a bad pain day can put you way beyond the safe…
When I messed with it I used Kagi's search and I didn't have that issue (not claiming they're the best, they're the only one I tried). They filter their results through their AI, though, so you get a sort of…
Sort of depends on how well the core reasoning works. It’s not a big effort to connect an LLM to a search provider. You do pay for the tokens, but in theory on a smaller model each token is cheaper.
That’s just two sides of the same coin. They run a proxy for LLM providers, which inevitably creates a marketplace. They’re amazon.com for tokens. The flip side that others are pointing out is that Amazon is sticky…
I don’t expect it to be exact or like code, but at the very least I expect it to be predictable and the “spirit of the law” fails that test often. I still remember GDPR coming out and I read til my head hurt, decided…
I would disagree with you, because "technical compliance" is compliance with the letter of the law. You have complied with every explicit requirement of the law. If the law is insufficient then legislature is free to…
Because it likely is, despite both their levity and the general lack of nuance in the CFAA. Quoted from 18 U.S.C. § 1030 (the CFAA) [1] (without quote blocks, because mobile): --- Start Quote (2) intentionally accesses…
I’ve bought some stuff off there and can tease out some aspects, though they may be after the fact rationalizations of subconscious effects. The first is price. The stuff is cheap, as in so cheap I know it will be…
It might just not be for you. I use OpenRouter because I do like being able to quickly check whether a new model works better, but mine is a “human in the loop” dev process so it won’t ruin a day of batch processing or…
It cost them more than normal food to maintain the stockpile. I’m not for profiteering but maintaining a stockpile implies excess production that spoils rather than being sold. It does seem fair to pay enough to cover…
I don’t think so because those both live in the context window and as such pollute it when they’re not performing optimally. I think having unused or rarely used weights doesn’t influence the results as poorly as RAG…
Do they do something neat with the colon? I do prefer the shorter keyword syntax, at least in Clojure because of how common they are. Clojure tends to use them very heavily though, and last I looked it seemed like…
I have little faith any of it would stop someone who was a) devoted, b) prepared, and c) had physical access for a reasonable time. It’s still worth doing because the vast, vast majority of people will fail at a or b…
The electricity company doesn’t have a contract that says they’ll only give electricity to specific people. Iron Mountain just doesn’t want to be in the middle, and I can see why. OSS went defunct, PBS files a lawsuit,…
Probably, but LLMs can’t execute code directly. They’d be making tool calls to make bash run ncat or curl or whatever that would be suspicious, as would any attempts to obfuscate it (“why is my agent doing an ‘eval…
Funnily enough, I would say almost the opposite. CC’s feature set is basically table stakes for an agent these days (does it have ACP yet? Very close to behind table stakes if not) and it has a lot of bloat powering…
I’m not endorsing the idea, but we could ban printing the card number on the card. New cards would only have a CVV, chip, mag strip and some way to differentiate between 2 cards from the same company (a colored dot?).…