Most of EA’s revenue comes from franchise games that are way below typical AAA standard. EA’s value is from IP not talent
Lots of situations, here are 2 I’ve faced recently (cannot give too much detail for privacy reasons, but should be clear enough) 1) low latency desired, long user prompt 2) function runs many parallel requests, but is…
All these things are designed to create lock in for companies. They don’t really fundamentally add to the functionality of LLMs. Devs should focus on working directly with model generate apis and not using all the…
I vastly prefer the manual caching. There are several aspects of automatic caching that are suboptimal, with only moderately less developer burden. I don’t use Anthropic much but I wish the others had manual cache…
A lot of the current code and science capabilities do not come from NTP training. Indeed in seems in most language model RL there is not even process supervision, so a long way from NTP
Cerebras has very limited scale. Mistral has very few users so they can use cerebra’s in inference whereas OpenAI and Anthropic cannot. If mistral grows a lot they will stop using cerebras
Fast tire changes only matter a very limited amount of the time (pretty much only if the extra time drops you a place, so there has to be 1 car/20 in a specific 1 second window on what is typically a 90s lap for 3s (a…
I imagine it runs civ 2 pretty well
WhatsApp is certainly worth less today than what they paid for it plus the extra funding it has required over time. Let alone producing anything close to ROI. Has lost them more money than the metaverse stuff. Insta was…
SFT is part of the classic RLHF process though
Yes this write-up is not about agents. In fact it’s a great illustration of why the hype around agents is misplaced!
I understand that calling it ‘agentic’ is nice for marketing, but most of what is described in this blog post is not related to agents. The design patterns you describe are explicitly non-agentic. Many of the use cases…
They may not be acting in good faith but there is extremely clear evidence that UCLA has engaged in illegal racial hiring and admissions practices and has supported antisemitism on campus. UCLA chose to give them that…
if you are p testing this isn’t the case. A positive result is a much stronger assertion
The term agent is just way overloaded. This guy defines it completely differently the the big labs, and I’ve seen half a dozen different definitions in the last few months. In the long run the definition used by OpenAI,…
Even as someone who is skeptical about LLMs, I’m not sure how anyone can look at what was achieved in AlphaGo and not at least consider the possibility that NNs could be superhuman in basically every domain at some point
I agree I find claude easily the best model, at least for programming which is the only thing I use LLMs for
SemiAnalysis has made up many things. They claim that a small Chinese hedge fund could acquire $1bln in GPUs, with no state support, including many sanctioned chips, then trained a model optimized for a far smaller…
SemiAnalysis is wrong. They just made their numbers up (among many other things they have invented - they are not to be trusted). I have observed many errors of understanding, analysis and calculation in their writing.…
DeepSeek v3 (where the training cost claims come from) was announced a month ago and it had no impact outside of a small circle
Texas is a world leader in renewable energy. Easy permitting, lots of space, lots of existing grid infrastructure from the o&g industry.
1) DPO did exclude some practical aspects of the RLHF method, e.g. pretraining gradients. 2) the theoretical arguments of DPO equivalence make some assumptions that don’t necessarily apply in practice 3) RLHF gives you…
The reality is that these are not culturally significant institutions and most people in London don’t care. Ordinary Londoners rarely use these markets, and they mostly sell to restaurants, and require major financial…
many of these labs have more funding in theory than OpenAI. FAIR, GDM, Qwen all are subsidiaries of companies with $10s of billions in annual profits.
Airbus was a company setup by consolidating companies controlled by some of the most powerful countries in the world, which sold planes to captive state airlines and militaries controlled by those same governments and…
Most of EA’s revenue comes from franchise games that are way below typical AAA standard. EA’s value is from IP not talent
Lots of situations, here are 2 I’ve faced recently (cannot give too much detail for privacy reasons, but should be clear enough) 1) low latency desired, long user prompt 2) function runs many parallel requests, but is…
All these things are designed to create lock in for companies. They don’t really fundamentally add to the functionality of LLMs. Devs should focus on working directly with model generate apis and not using all the…
I vastly prefer the manual caching. There are several aspects of automatic caching that are suboptimal, with only moderately less developer burden. I don’t use Anthropic much but I wish the others had manual cache…
A lot of the current code and science capabilities do not come from NTP training. Indeed in seems in most language model RL there is not even process supervision, so a long way from NTP
Cerebras has very limited scale. Mistral has very few users so they can use cerebra’s in inference whereas OpenAI and Anthropic cannot. If mistral grows a lot they will stop using cerebras
Fast tire changes only matter a very limited amount of the time (pretty much only if the extra time drops you a place, so there has to be 1 car/20 in a specific 1 second window on what is typically a 90s lap for 3s (a…
I imagine it runs civ 2 pretty well
WhatsApp is certainly worth less today than what they paid for it plus the extra funding it has required over time. Let alone producing anything close to ROI. Has lost them more money than the metaverse stuff. Insta was…
SFT is part of the classic RLHF process though
Yes this write-up is not about agents. In fact it’s a great illustration of why the hype around agents is misplaced!
I understand that calling it ‘agentic’ is nice for marketing, but most of what is described in this blog post is not related to agents. The design patterns you describe are explicitly non-agentic. Many of the use cases…
They may not be acting in good faith but there is extremely clear evidence that UCLA has engaged in illegal racial hiring and admissions practices and has supported antisemitism on campus. UCLA chose to give them that…
if you are p testing this isn’t the case. A positive result is a much stronger assertion
The term agent is just way overloaded. This guy defines it completely differently the the big labs, and I’ve seen half a dozen different definitions in the last few months. In the long run the definition used by OpenAI,…
Even as someone who is skeptical about LLMs, I’m not sure how anyone can look at what was achieved in AlphaGo and not at least consider the possibility that NNs could be superhuman in basically every domain at some point
I agree I find claude easily the best model, at least for programming which is the only thing I use LLMs for
SemiAnalysis has made up many things. They claim that a small Chinese hedge fund could acquire $1bln in GPUs, with no state support, including many sanctioned chips, then trained a model optimized for a far smaller…
SemiAnalysis is wrong. They just made their numbers up (among many other things they have invented - they are not to be trusted). I have observed many errors of understanding, analysis and calculation in their writing.…
DeepSeek v3 (where the training cost claims come from) was announced a month ago and it had no impact outside of a small circle
Texas is a world leader in renewable energy. Easy permitting, lots of space, lots of existing grid infrastructure from the o&g industry.
1) DPO did exclude some practical aspects of the RLHF method, e.g. pretraining gradients. 2) the theoretical arguments of DPO equivalence make some assumptions that don’t necessarily apply in practice 3) RLHF gives you…
The reality is that these are not culturally significant institutions and most people in London don’t care. Ordinary Londoners rarely use these markets, and they mostly sell to restaurants, and require major financial…
many of these labs have more funding in theory than OpenAI. FAIR, GDM, Qwen all are subsidiaries of companies with $10s of billions in annual profits.
Airbus was a company setup by consolidating companies controlled by some of the most powerful countries in the world, which sold planes to captive state airlines and militaries controlled by those same governments and…