150M at 5B revenue is not great: that's 3% margin! The bigger issue is that console manufacturer revenue is highly cyclical. This is hard to see in e.g. Xbox and Sony since they are both part of a larger conglomerate,…
You can get rid of 99.9% of those attacks by simply dispatching the data consumption to a different instance of the LLM, see, for instance, some of the later patterns in https://arxiv.org/abs/2506.08837
The issue with having a "no answer" option is that you implicitly add a decision problem into your test that depends on the "cost" of answering wrong. Specifically, your model now has two "correct" classes p(class=y|x)…
Because the size of the attention matrix depends on the number of tokens (this is what makes attention N^2). If you don't care about having a flexible number of input tokens (e.g. in image processing) you can learn a…
Nothing is stopping them, it's just not worth it: Have a look at e.g. vast.ai's pricing (https://vast.ai/pricing). The V100 (2017 -> 9 years old) can be rented from $0.02 to $0.37/h (right now I can find a V100 with a…
Regarding specifically depth anything: You're not running this on a microcontroller. In general, CNNs still reign supreme on microcontrollers since you have a way lower peak memory demand which is what usually kills…
Then allow resale through the platform at the original purchase price. You still have no scalping, but you recover the ability to back out due to unforeseen events
It works the same way: softmax is essentially just applying the normalization to the vector exp(x). From an "engineering" POV this effectively ensures that the vector you normalize has strictly positive entries, so the…
I'm what way is that different? You return early and the call Cascades up the call chain until you handle it (otherwise it's always an "either" results) In practice you use something like an exception monad, which makes…
Of course you can: you just have to define it in your type. The output set becomes a union type of the normal output and whatever you want as an exception. If you write this as a monad, your get very similar syntax to…
Effectively none. The US has a huge trade deficit with Germany/Europe so there is practically never a case where the US receives gold from Germany: It's always more then offset by the deficit. The equivalent for the US…
Germany already repatriated about half of its gold reserves between 2013 and 2017 from paris and new york to frankfurt. There has been a recent (as in "18th of march" recent) petition to the Bundestag to repatriate the…
Whether the US is capable of hiding their maleficence or not should not be an indicator of whether it is safe to deal with them. If your indicator for the US being a good partner in _anything_ is that "well we did…
There were plenty of models the size of gpt3 in industry. The core insight necessary for chatgpt was not scaling (that was already widely accepted): the insight was that instead of finetuning for each individual task,…
Assuming this is real: Why do you think anthropic was put on what is essentially an "enemy of the state" list and openai didn't? The two things anthropic refused to do is mass surveillance and autonomous weapons, so why…
It might be that they pay less for anthropic depending how many tokens are generated by each model: total cost is token cost times number of tokens. I haven't checked gpt5, but it is not impossible that price wise they…
This is essentially the principle behind algebraic effects (which, in practice, do get implemented as delimited continuations): When you have an impure effect (e.g. check a database, generate a random number, write to a…
Once you have strong normalization you can just check local confluence and use Newman's lemma to get strong confluence. That should be pretty easy: just build all n^2 pairs and run them to termination (which you have…
That entirely depends on what AMD device you look at: gaming GPUs are not well supported, but their instinct line of accelerators works just as well as cuda. keep in mind that, in contrast to Nvidia, AMD uses different…
To expand on that: there's also the issue that these games have to be (somewhat) competitive multiplayer games: multiplayer because otherwise there's no way to create enough content, and competitive since otherwise…
There are alternatives to iron that have higher efficiency and lower prices. For instance https://hydrogenious.net/ does exactly that but with benzene like structures. The advantage of this is that you can reuse…
The paper I have mentioned can be found here https://arxiv.org/pdf/2206.09787 There are so many things that have only been invented in the last couple of years like RINS, MCF cuts, conflict analysis, symmetry detection,…
2008 is ancient for optimization! People have tested old year 2000 lp and milp solvers against recent ones while correcting for hardware. Hardware improvements made up ~20x improvement, while lp solvers in general sped…
You can solve L1 regression using linear programming at fantastically large scales. In fact in many applications you do the opposite: go from squared to absolute because the latter fits into in lp
The problem was mostly that the only guy that was really backing the project (Christian Ude, SPD), was replaced with his successor (Dieter Reiter, SPD) who just didn't have the drive necessary to maintain the project.…
150M at 5B revenue is not great: that's 3% margin! The bigger issue is that console manufacturer revenue is highly cyclical. This is hard to see in e.g. Xbox and Sony since they are both part of a larger conglomerate,…
You can get rid of 99.9% of those attacks by simply dispatching the data consumption to a different instance of the LLM, see, for instance, some of the later patterns in https://arxiv.org/abs/2506.08837
The issue with having a "no answer" option is that you implicitly add a decision problem into your test that depends on the "cost" of answering wrong. Specifically, your model now has two "correct" classes p(class=y|x)…
Because the size of the attention matrix depends on the number of tokens (this is what makes attention N^2). If you don't care about having a flexible number of input tokens (e.g. in image processing) you can learn a…
Nothing is stopping them, it's just not worth it: Have a look at e.g. vast.ai's pricing (https://vast.ai/pricing). The V100 (2017 -> 9 years old) can be rented from $0.02 to $0.37/h (right now I can find a V100 with a…
Regarding specifically depth anything: You're not running this on a microcontroller. In general, CNNs still reign supreme on microcontrollers since you have a way lower peak memory demand which is what usually kills…
Then allow resale through the platform at the original purchase price. You still have no scalping, but you recover the ability to back out due to unforeseen events
It works the same way: softmax is essentially just applying the normalization to the vector exp(x). From an "engineering" POV this effectively ensures that the vector you normalize has strictly positive entries, so the…
I'm what way is that different? You return early and the call Cascades up the call chain until you handle it (otherwise it's always an "either" results) In practice you use something like an exception monad, which makes…
Of course you can: you just have to define it in your type. The output set becomes a union type of the normal output and whatever you want as an exception. If you write this as a monad, your get very similar syntax to…
Effectively none. The US has a huge trade deficit with Germany/Europe so there is practically never a case where the US receives gold from Germany: It's always more then offset by the deficit. The equivalent for the US…
Germany already repatriated about half of its gold reserves between 2013 and 2017 from paris and new york to frankfurt. There has been a recent (as in "18th of march" recent) petition to the Bundestag to repatriate the…
Whether the US is capable of hiding their maleficence or not should not be an indicator of whether it is safe to deal with them. If your indicator for the US being a good partner in _anything_ is that "well we did…
There were plenty of models the size of gpt3 in industry. The core insight necessary for chatgpt was not scaling (that was already widely accepted): the insight was that instead of finetuning for each individual task,…
Assuming this is real: Why do you think anthropic was put on what is essentially an "enemy of the state" list and openai didn't? The two things anthropic refused to do is mass surveillance and autonomous weapons, so why…
It might be that they pay less for anthropic depending how many tokens are generated by each model: total cost is token cost times number of tokens. I haven't checked gpt5, but it is not impossible that price wise they…
This is essentially the principle behind algebraic effects (which, in practice, do get implemented as delimited continuations): When you have an impure effect (e.g. check a database, generate a random number, write to a…
Once you have strong normalization you can just check local confluence and use Newman's lemma to get strong confluence. That should be pretty easy: just build all n^2 pairs and run them to termination (which you have…
That entirely depends on what AMD device you look at: gaming GPUs are not well supported, but their instinct line of accelerators works just as well as cuda. keep in mind that, in contrast to Nvidia, AMD uses different…
To expand on that: there's also the issue that these games have to be (somewhat) competitive multiplayer games: multiplayer because otherwise there's no way to create enough content, and competitive since otherwise…
There are alternatives to iron that have higher efficiency and lower prices. For instance https://hydrogenious.net/ does exactly that but with benzene like structures. The advantage of this is that you can reuse…
The paper I have mentioned can be found here https://arxiv.org/pdf/2206.09787 There are so many things that have only been invented in the last couple of years like RINS, MCF cuts, conflict analysis, symmetry detection,…
2008 is ancient for optimization! People have tested old year 2000 lp and milp solvers against recent ones while correcting for hardware. Hardware improvements made up ~20x improvement, while lp solvers in general sped…
You can solve L1 regression using linear programming at fantastically large scales. In fact in many applications you do the opposite: go from squared to absolute because the latter fits into in lp
The problem was mostly that the only guy that was really backing the project (Christian Ude, SPD), was replaced with his successor (Dieter Reiter, SPD) who just didn't have the drive necessary to maintain the project.…