> Do all other providers somehow overcharge by that much? This, I think. Cached inputs have an opportunity cost (keeping the KV cache until use) but a hit is basically free. “Basically” - if the cache is offloaded to…
You're gonna want a custom vLLM build. Here's a runbook: https://github.com/local-inference-lab/rtx6kpro/blob/master/... If the newer builds aren't working, you might try running the old v6 build (based on the…
> Aggregate token throughput is about 30% lower (122 vs 170 tok/s at 16 users) Is that actually the aggregate throughput? 8xB300 (with 4TB/s/GPU bandwidth) is only pushing 8 tg/s/session? That seems… incredibly low,…
More than that, the AI disclaimer itself is a hallucination: > Gemini 4 helped with the editing. There is no Gemini 4, unless the author is writing from the future.
FWIW, you can get a 16x RTX 6000 Pro setup running for significantly less than that. Even considering the electrical hookup fees (it’s a lot of power and cooling). Home ownership might push you into the original quote…
> The fix that worked is a schema transform at the provider boundary. For OpenAI-family models only, we rewrite every optional property to be required but nullable, using anyOf: [T, null], which gives the model an…
I don't think llama.cpp supports any of the LongCat models, actually. They haven't posted weights/inference solutions for LongCat-2.0 [1], but LongCat-Next had transformers support, which I assume means it works with…
At UVA many years ago, one of my roommates was one of the unfortunate 20 or so annually expelled -- the only outcome of being convicted of breaking the "no cheating, stealing, or lying" honor code. It didn't take repeat…
> I want to be careful here. was the giveaway for me
The reasoning generally isn't kept in the context, so after choosing the secret word in the first reasoning block, the LLM will have completely forgotten it in the second and subsequent requests. So, it technically…
Epic Anti-Cheat fully supports Linux[1]. I believe what the GP comment means is that the Fortnite publishers opted not to tick the “allow Linux” checkbox on the developer portal website. There is probably more nuance…
Without knowing anything about Tor, I'd guess you've got it backwards. I imagine Tor leaks your OS through TCP/IP fingerprinting, and whether that fingerprint matches your `navigator.platform` is probably a factor into…
If you're given a button to click, your browser has successfully passed the environment integrity checks and you have not been flagged as a bot. You'll be flagged as a bot if your browser configuration has something…
Interestingly, not only do both versions emit the same assembly, but clang both autovectorizes and unrolls the loop: https://godbolt.org/z/qxsKWfz9s
This looks like it, I think: https://searchfox.org/mozilla-central/source/toolkit/xre/dll...
> what if someone turns [password authentication back] on sshd_config requires root to modify, so you've got bigger problems than weak passwords at this point.
Less than skips over, utility based shopping is explicitly derided: > The narrative that you just told me [about utility shopping] is “I am a very analytical person who only has book smarts and no emotions”. And that…
This is briefly mentioned in the article, but from the report[1]: > It should be noted that the scope of the code reviewed within this audit is relatively narrow. In particular, while we audited cURL’s use of the…
Given the exploit vector looks like yet another iMessage attachment bug, > The target iOS device receives a message via the iMessage service, with an attachment containing an exploit. and that one of the effects of…
> banned by Microsoft for breach of TOS, whatever that might have been FWIW, I had the same thing happen and found out the ban reason was "fraud (please insert phone number)".
I believe GP is referring to the multiple AI-driven vtubers on Twitch (vedal987 and motherv3 I think?). They're not yet 24/7 because they still require human supervision for reasons -- vedal987 was recently banned for…
Probably just an extension to existing ETSI legal interception interfaces[1] that I believe are required to be implemented by all service providers of a certain size in the EU. Your personal email server and private IRC…
> but prohibitions on Congressmen remain in force [i.e. 2020 congressional insider trading] Is it really "in force" when, despite much ado, no charges were brought in the linked scandal [1][2]? I don't really have a…
Are you using the no-javascript version (“HTML” version), by any chance? If so, you might find the “fully-featured” version has better^W results, at the cost of requiring Javascript and all that entails.
As a regular user of the Javascript-less page, several months ago it started returning wildly different results than the “fully featured” version for the same queries. My uneducated guess is that it’s using a different…
> Do all other providers somehow overcharge by that much? This, I think. Cached inputs have an opportunity cost (keeping the KV cache until use) but a hit is basically free. “Basically” - if the cache is offloaded to…
You're gonna want a custom vLLM build. Here's a runbook: https://github.com/local-inference-lab/rtx6kpro/blob/master/... If the newer builds aren't working, you might try running the old v6 build (based on the…
> Aggregate token throughput is about 30% lower (122 vs 170 tok/s at 16 users) Is that actually the aggregate throughput? 8xB300 (with 4TB/s/GPU bandwidth) is only pushing 8 tg/s/session? That seems… incredibly low,…
More than that, the AI disclaimer itself is a hallucination: > Gemini 4 helped with the editing. There is no Gemini 4, unless the author is writing from the future.
FWIW, you can get a 16x RTX 6000 Pro setup running for significantly less than that. Even considering the electrical hookup fees (it’s a lot of power and cooling). Home ownership might push you into the original quote…
> The fix that worked is a schema transform at the provider boundary. For OpenAI-family models only, we rewrite every optional property to be required but nullable, using anyOf: [T, null], which gives the model an…
I don't think llama.cpp supports any of the LongCat models, actually. They haven't posted weights/inference solutions for LongCat-2.0 [1], but LongCat-Next had transformers support, which I assume means it works with…
At UVA many years ago, one of my roommates was one of the unfortunate 20 or so annually expelled -- the only outcome of being convicted of breaking the "no cheating, stealing, or lying" honor code. It didn't take repeat…
> I want to be careful here. was the giveaway for me
The reasoning generally isn't kept in the context, so after choosing the secret word in the first reasoning block, the LLM will have completely forgotten it in the second and subsequent requests. So, it technically…
Epic Anti-Cheat fully supports Linux[1]. I believe what the GP comment means is that the Fortnite publishers opted not to tick the “allow Linux” checkbox on the developer portal website. There is probably more nuance…
Without knowing anything about Tor, I'd guess you've got it backwards. I imagine Tor leaks your OS through TCP/IP fingerprinting, and whether that fingerprint matches your `navigator.platform` is probably a factor into…
If you're given a button to click, your browser has successfully passed the environment integrity checks and you have not been flagged as a bot. You'll be flagged as a bot if your browser configuration has something…
Interestingly, not only do both versions emit the same assembly, but clang both autovectorizes and unrolls the loop: https://godbolt.org/z/qxsKWfz9s
This looks like it, I think: https://searchfox.org/mozilla-central/source/toolkit/xre/dll...
> what if someone turns [password authentication back] on sshd_config requires root to modify, so you've got bigger problems than weak passwords at this point.
Less than skips over, utility based shopping is explicitly derided: > The narrative that you just told me [about utility shopping] is “I am a very analytical person who only has book smarts and no emotions”. And that…
This is briefly mentioned in the article, but from the report[1]: > It should be noted that the scope of the code reviewed within this audit is relatively narrow. In particular, while we audited cURL’s use of the…
Given the exploit vector looks like yet another iMessage attachment bug, > The target iOS device receives a message via the iMessage service, with an attachment containing an exploit. and that one of the effects of…
> banned by Microsoft for breach of TOS, whatever that might have been FWIW, I had the same thing happen and found out the ban reason was "fraud (please insert phone number)".
I believe GP is referring to the multiple AI-driven vtubers on Twitch (vedal987 and motherv3 I think?). They're not yet 24/7 because they still require human supervision for reasons -- vedal987 was recently banned for…
Probably just an extension to existing ETSI legal interception interfaces[1] that I believe are required to be implemented by all service providers of a certain size in the EU. Your personal email server and private IRC…
> but prohibitions on Congressmen remain in force [i.e. 2020 congressional insider trading] Is it really "in force" when, despite much ado, no charges were brought in the linked scandal [1][2]? I don't really have a…
Are you using the no-javascript version (“HTML” version), by any chance? If so, you might find the “fully-featured” version has better^W results, at the cost of requiring Javascript and all that entails.
As a regular user of the Javascript-less page, several months ago it started returning wildly different results than the “fully featured” version for the same queries. My uneducated guess is that it’s using a different…