The problem is that if OpenAI doesn't want the compute nobody does. All of these companies' demand for compute are correlated. It isn't likely that OpenAI will want less compute in isolation. Furthermore, the circular…
I am willing to give Mr. Amodei the benefit of the doubt in the sincerity of his beliefs. Everyone assumes his motivations have to be perfectly rational and can't contradict but that's not how people act in practice.…
They really do believe AI might kill everyone. They also are highly motivated by hoarding capital and power. I don't know if researchers are aware that they're acting indistinguishably from someone who is just really…
Because for a lot (most?) people their iPhone is their primary and only personal computer. I also want a smaller phone. I bet Apple designers would love to sell you a smaller phone. They've certainly tried with my…
Even if the potential of the technology could really be that world altering, the reality of economics constrain the realization of that potential. AI may provide economic benefits but it is far from a free lunch. Can…
I think this might be a red herring. All it takes is someone to get an inkling that someone is working on a new approach and seeing some success for OpenAI to fire the AI cannon at the problem. The community seems…
If you can't resist the temptation to pull the AI slot machine lever (which is not necessarily a personal failing!), you might want to seriously examine what your actual motivations are. If you have to use AI for your…
The comparison breaks down because noise pollution is unavoidable. AI hype might be unavoidable unless you code in a vacuum but you can be disciplined in how much you let it in. Even if AI cheapens the actual output, it…
It is probably why RLHF was the secret sauce to make LLMs vastly more useful. Obviously it makes their output more likely to be aligned. But also by mimicking conversation it makes you prompt it better. It manipulates…
If they were buying GPUs with equity then it wouldn't show up on Nvidia's quarterly report as revenue, even if the net trade is GPUs for equity. This is the point of the structure, to make cash flows show up as top line…
The distinction does make a difference and it is the former. These circular deals are two paired transactions: 1. Nvidia buys equity in an AI lab or cloud provider with cash. 2. The counterparty agrees to buy X number…
What is the overhead to have agents play model UN? Why is the coordination so elaborate? It sounds like a deeply complex and expensive emergent behavior that maybe looks comprehensible but could be nonsensical. Also…
Using AI is kayfabe. What I mean is, you create interaction patterns that resemble how humans work. This is because it is what the models are trained on but also because we've all been trained to interact in this way.…
So I've been working on a project in Rust because a library that's appropriate for the design has a terrific Rust API and a miserable C API. I've been loosely tracking Rust since before 1.0 and I've never felt it's a…
I think every project should seriously ask itself if it actually needs manual memory management. My hunch is that most people who think they need it, do not. If you really truly do need it, then yes Rust is a great way…
Trust, or lack thereof. People don't trust OpenAI, a company whose very name is essentially a deception and a lie. People don't trust the tech industry in general anymore. Most tech companies act as a tax on otherwise…
This is just a bubble by another name. To use tech as an example, remember that the dot-com bubble was really three crashes: the crash of the dot-com companies in 2000, the telecom crash in 2001, and the media crash in…
Oracle has bet the house on AI. Free cash flow is deeply negative with tons more capex guidance on the books. They are currently the largest non-financial corporate issuer of new debt in the corporate bond market. They…
Total addressable market doesn't pay interest expenses. Even if this technology really did have the potential to be as revolutionary as the move from the horse to the car, if you can't get there with what the world…
Certainly, but a flop of $1.5 trillion would create a deep and long trough. I think in that situation OpenAI and Anthropic probably don't survive as independent companies (where is the revenue? who would want to put…
The $1.5 trillion number is extremely relevant because it makes the revenue numbers the industry has to hit higher and there's an expectation to see progress sooner before funding starts getting pulled back.
They can and do. Since at least the 10s automakers have been using tricks like pumping the engine sound into the main cabin or using speakers playing an audio file. The speakers usually toggle when the car is in "sports…
Probably both. Having a strong frontier model is necessary not just for the model itself but because it provides a halo effect for your entire line. So if Google could deliver a pro model they would. But I also think…
For sure! Why is Google throwing their own language under the bus? They're literally saying in their article Go isn't the easiest language to write but that doesn't matter because its the best for maintaining a project.…
"The death of the American Dream" has been explored ad nauseam throughout the 20th and 21st centuries. It definitely pokes its head out more prominently in times of political and economic upheaval (eg the 60s and 70s,…
The problem is that if OpenAI doesn't want the compute nobody does. All of these companies' demand for compute are correlated. It isn't likely that OpenAI will want less compute in isolation. Furthermore, the circular…
I am willing to give Mr. Amodei the benefit of the doubt in the sincerity of his beliefs. Everyone assumes his motivations have to be perfectly rational and can't contradict but that's not how people act in practice.…
They really do believe AI might kill everyone. They also are highly motivated by hoarding capital and power. I don't know if researchers are aware that they're acting indistinguishably from someone who is just really…
Because for a lot (most?) people their iPhone is their primary and only personal computer. I also want a smaller phone. I bet Apple designers would love to sell you a smaller phone. They've certainly tried with my…
Even if the potential of the technology could really be that world altering, the reality of economics constrain the realization of that potential. AI may provide economic benefits but it is far from a free lunch. Can…
I think this might be a red herring. All it takes is someone to get an inkling that someone is working on a new approach and seeing some success for OpenAI to fire the AI cannon at the problem. The community seems…
If you can't resist the temptation to pull the AI slot machine lever (which is not necessarily a personal failing!), you might want to seriously examine what your actual motivations are. If you have to use AI for your…
The comparison breaks down because noise pollution is unavoidable. AI hype might be unavoidable unless you code in a vacuum but you can be disciplined in how much you let it in. Even if AI cheapens the actual output, it…
It is probably why RLHF was the secret sauce to make LLMs vastly more useful. Obviously it makes their output more likely to be aligned. But also by mimicking conversation it makes you prompt it better. It manipulates…
If they were buying GPUs with equity then it wouldn't show up on Nvidia's quarterly report as revenue, even if the net trade is GPUs for equity. This is the point of the structure, to make cash flows show up as top line…
The distinction does make a difference and it is the former. These circular deals are two paired transactions: 1. Nvidia buys equity in an AI lab or cloud provider with cash. 2. The counterparty agrees to buy X number…
What is the overhead to have agents play model UN? Why is the coordination so elaborate? It sounds like a deeply complex and expensive emergent behavior that maybe looks comprehensible but could be nonsensical. Also…
Using AI is kayfabe. What I mean is, you create interaction patterns that resemble how humans work. This is because it is what the models are trained on but also because we've all been trained to interact in this way.…
So I've been working on a project in Rust because a library that's appropriate for the design has a terrific Rust API and a miserable C API. I've been loosely tracking Rust since before 1.0 and I've never felt it's a…
I think every project should seriously ask itself if it actually needs manual memory management. My hunch is that most people who think they need it, do not. If you really truly do need it, then yes Rust is a great way…
Trust, or lack thereof. People don't trust OpenAI, a company whose very name is essentially a deception and a lie. People don't trust the tech industry in general anymore. Most tech companies act as a tax on otherwise…
This is just a bubble by another name. To use tech as an example, remember that the dot-com bubble was really three crashes: the crash of the dot-com companies in 2000, the telecom crash in 2001, and the media crash in…
Oracle has bet the house on AI. Free cash flow is deeply negative with tons more capex guidance on the books. They are currently the largest non-financial corporate issuer of new debt in the corporate bond market. They…
Total addressable market doesn't pay interest expenses. Even if this technology really did have the potential to be as revolutionary as the move from the horse to the car, if you can't get there with what the world…
Certainly, but a flop of $1.5 trillion would create a deep and long trough. I think in that situation OpenAI and Anthropic probably don't survive as independent companies (where is the revenue? who would want to put…
The $1.5 trillion number is extremely relevant because it makes the revenue numbers the industry has to hit higher and there's an expectation to see progress sooner before funding starts getting pulled back.
They can and do. Since at least the 10s automakers have been using tricks like pumping the engine sound into the main cabin or using speakers playing an audio file. The speakers usually toggle when the car is in "sports…
Probably both. Having a strong frontier model is necessary not just for the model itself but because it provides a halo effect for your entire line. So if Google could deliver a pro model they would. But I also think…
For sure! Why is Google throwing their own language under the bus? They're literally saying in their article Go isn't the easiest language to write but that doesn't matter because its the best for maintaining a project.…
"The death of the American Dream" has been explored ad nauseam throughout the 20th and 21st centuries. It definitely pokes its head out more prominently in times of political and economic upheaval (eg the 60s and 70s,…