I was surprised to learn that this has a name (or a few) > Rabbit starvation (also called protein poisoning or mal de caribou) The body can only digest so much protein and rabbits are so lean there is basically no fat…
You’d hope so, though it’s not unheard of to get this wrong. Fastly managed to snapshot guest seeds and use them at runtime for RNG in their WASM snapshots a few years ago https://nvd.nist.gov/vuln/detail/cve-2022-39218
Solar is very popular in Australia, to the point that we have too much surplus during the day. So now we often have effectively free energy late morning to early afternoon. So while not common, some people here do get…
Yes, but specifically they sell hardware at absurd margins, and lock people in via their software ecosystem.
They do heavily use AI, but you haven’t refuted their point that if inventory is in SQL, storing reservation in a second storage system increases complexity.
Yes, this is a great point and it’s even one that the Cerebras CEO spruiks for his own chips. Talaas has gone furthest on the spectrum here, so seems to have the most potential to evolve the use cases.
Taalas is developing this, but not for Frontier class models. I hope that if we can least get the easy 80% of work done on that sort of hardware, we can greatly reduce the demand for GPUs, HBM and energy to some extent.
They’re not using ciphertext in inference. They are encrypting agent responses on their servers if it’s going to a subagent on the client. The subagent will send it back to their servers for inference. Only their…
Yeah, if user -> org tenancy is stored in the same database without any similar defence in depth then a fresh API key after updating org would work around this. Would be a interesting topic for them to cover. I think…
The OPs point wasn’t that OpenAis financial situation is comparable to Apples. It was that the likely cost of litigation is a drop in the ocean for OpenAi too despite their comparative lack of cash to burn. Legal…
That’s what they do, but the TPM pepper is also needed for HMACing in their threat model. Otherwise the attacker just adds the victim’s user id to their hashing process too.
Zero data retention was an enterprise agreement that Anthropic and Amazon agreed with customers and delivered on. There’s no way AWS would trade in their reputation with enterprises just to soak up some slop.
I’ve seen whole teams at companies set up fail to provide these booleans-as-a-service well. There are whole companies like LaunchDarkly for them. If you boil it down to this, you may as well boil down every service that…
At least Anthropic claims that they are profitable on a per model basis. But since both revenue and training costs are growing exponentially, and they need to pay for model N training today, and only get revenue for…
Yes, but it’s a common misconception that impact is a bad thing. The body, including bones, muscles, tendons and joints, adapt to stress. Many people do too little, not too much, as they get older. There’s a limit to…
I also think fsync before acking writes is a better default. That aside, if you were to choose async for batching writes, their default value surprises me. 2 minutes seems like an eternity. Would you not get very good…
Yes, the greenest browser is one that doesn’t use AI. They aren’t claiming they’ve built that though, just the greenest AI.
It’s interesting that the author chose to use SHA256 hashing for the CPU intensive workload. Given they run on hardware acceleration using AES NI, I wonder how generally applicable it is. Still interesting either way…
Yeah, investing in the top companies leads to higher returns for most periods when looking short term. Over longer periods, the top companies by market cap tend to change though.…
> At successful tech companies, engineering work is valued in proportion to how much money it makes the company If you look at what it actually takes to get promoted at most tech companies I’d say this isn’t generally…
Runtimes with garbage collectors typically optimize for allocation, not deletion.
JOOQ handled this nicely. https://www.jooq.org/doc/latest/manual/sql-execution/crud-wi...
CockroachDB is presumably what they’re referring to in: > For Postgres-compatible NewSQL, we would’ve had one of the largest single-cluster footprints for cloud-managed distributed Postgres. We didn’t want to bear the…
While they don’t specify it sounds like they don’t even require 2FA to access their systems?
Tangential to the authors point, but it’s funny to note many new SQL databases(e.g CockroachDB, TiDB, MyRocks) are written on top of RocksDB, a “NoSQL” key value store.
I was surprised to learn that this has a name (or a few) > Rabbit starvation (also called protein poisoning or mal de caribou) The body can only digest so much protein and rabbits are so lean there is basically no fat…
You’d hope so, though it’s not unheard of to get this wrong. Fastly managed to snapshot guest seeds and use them at runtime for RNG in their WASM snapshots a few years ago https://nvd.nist.gov/vuln/detail/cve-2022-39218
Solar is very popular in Australia, to the point that we have too much surplus during the day. So now we often have effectively free energy late morning to early afternoon. So while not common, some people here do get…
Yes, but specifically they sell hardware at absurd margins, and lock people in via their software ecosystem.
They do heavily use AI, but you haven’t refuted their point that if inventory is in SQL, storing reservation in a second storage system increases complexity.
Yes, this is a great point and it’s even one that the Cerebras CEO spruiks for his own chips. Talaas has gone furthest on the spectrum here, so seems to have the most potential to evolve the use cases.
Taalas is developing this, but not for Frontier class models. I hope that if we can least get the easy 80% of work done on that sort of hardware, we can greatly reduce the demand for GPUs, HBM and energy to some extent.
They’re not using ciphertext in inference. They are encrypting agent responses on their servers if it’s going to a subagent on the client. The subagent will send it back to their servers for inference. Only their…
Yeah, if user -> org tenancy is stored in the same database without any similar defence in depth then a fresh API key after updating org would work around this. Would be a interesting topic for them to cover. I think…
The OPs point wasn’t that OpenAis financial situation is comparable to Apples. It was that the likely cost of litigation is a drop in the ocean for OpenAi too despite their comparative lack of cash to burn. Legal…
That’s what they do, but the TPM pepper is also needed for HMACing in their threat model. Otherwise the attacker just adds the victim’s user id to their hashing process too.
Zero data retention was an enterprise agreement that Anthropic and Amazon agreed with customers and delivered on. There’s no way AWS would trade in their reputation with enterprises just to soak up some slop.
I’ve seen whole teams at companies set up fail to provide these booleans-as-a-service well. There are whole companies like LaunchDarkly for them. If you boil it down to this, you may as well boil down every service that…
At least Anthropic claims that they are profitable on a per model basis. But since both revenue and training costs are growing exponentially, and they need to pay for model N training today, and only get revenue for…
Yes, but it’s a common misconception that impact is a bad thing. The body, including bones, muscles, tendons and joints, adapt to stress. Many people do too little, not too much, as they get older. There’s a limit to…
I also think fsync before acking writes is a better default. That aside, if you were to choose async for batching writes, their default value surprises me. 2 minutes seems like an eternity. Would you not get very good…
Yes, the greenest browser is one that doesn’t use AI. They aren’t claiming they’ve built that though, just the greenest AI.
It’s interesting that the author chose to use SHA256 hashing for the CPU intensive workload. Given they run on hardware acceleration using AES NI, I wonder how generally applicable it is. Still interesting either way…
Yeah, investing in the top companies leads to higher returns for most periods when looking short term. Over longer periods, the top companies by market cap tend to change though.…
> At successful tech companies, engineering work is valued in proportion to how much money it makes the company If you look at what it actually takes to get promoted at most tech companies I’d say this isn’t generally…
Runtimes with garbage collectors typically optimize for allocation, not deletion.
JOOQ handled this nicely. https://www.jooq.org/doc/latest/manual/sql-execution/crud-wi...
CockroachDB is presumably what they’re referring to in: > For Postgres-compatible NewSQL, we would’ve had one of the largest single-cluster footprints for cloud-managed distributed Postgres. We didn’t want to bear the…
While they don’t specify it sounds like they don’t even require 2FA to access their systems?
Tangential to the authors point, but it’s funny to note many new SQL databases(e.g CockroachDB, TiDB, MyRocks) are written on top of RocksDB, a “NoSQL” key value store.