> using open weights models AWS and Azure give you the same thing for Claude and ChatGPT, no need to be stuck with open weights. They might sometimes store some of it for other purposes (I don't know the specifics), but…
Or just use Azure, AWS, etc. for Claude/ChatGPT inference, where the AI labs never even get your data in their data centers at all. You pay more for it, but if you care that much, use it.
> There is no similar currency that Nvidia can create ad infinitum. It can create obligations to provide future GPUs in return for present money. Yes at some point people might start to question, but what are the true…
The CHIPS Act in the US did set aside a reserve for older processes used for automobile, defense, and industrial semiconductors - but that's not gaming GPUs that used the previous process node.
NVidia is limited by the number of chips they can produce. If you can fab 1000 chips, and can sell some for $500 and some for $80000 what are you going to do? The game GPU is at once profitable, but causes them to give…
> Do you really want the rust compiler to run at the speed of an llm? That... might actually be an improvement?
> a Jeffreys prior will happen to make it satisfy the definition of a confidence interval as well Correct, which is why it's crazy to consider a Jeffrey's credible interval as valid, but not a confidence interval.…
That's why this paper is important - it shows it isn't trained out. Leaving no other information in the model makes it clear what the biases are, and that the model is willing to make a biased decision. If you give it…
> Maybe their hardware is incapable I am unsure if it is incapable, but it sounds hard. They have tons of cores with 64k of SRAM each, and relatively slow paths in/out. On a GPU you can leave it in SRAM. On Cerebras,…
The insane valuations for selling a dream are what make VC worthwhile. TSLA would be worth crap if it were a private company giving off dividends. It is really truly about the insane valuations driven by collective…
> Something that is sustainable with a small team. These days, it can be sustainable for a tiny team, named Claude and Luna. Why doesn't every engineer have a side project or three for small market things of this…
I would maybe argue that Einstein was the most LLM-like of great thinkers. A lot of his great discoveries were mostly that he was very knowledgeable about the bleeding edge research in a number of disparate areas, and…
What if it can be Einstein, but can't draw a Pelican, write a solid college-level essay, or fold clothes? The ability to do a ton of book learning in training, and pull in tons of related context at once, is superhuman…
It's no different than generally using AWS.
The foundation of the businesses training AI models. So don't use them for inference.
> It's quite shocking to me how many experienced, tech-savvy people, who used to care about cookies and ad tracking - are now willingly sending their business strategies, highly confidential contracts, and intimate…
Are you training something so big you need that much unified RAM though? If you can fit it on a GPU, and especially for training, it is so much quicker than a Mac.
It is a completely comparison for me as a consumer, since they're the costs and benefits that I'll actually get.
> They also have enough power to negotiate contracts with strong privacy provisions. What privacy provisions would you want to add to AWS? Most of the reasonable strong privacy provisions you'd want are already there…
How would this allow compile-time resolution of virtuals that was not possible before? Gcc can already do link-time devirtualization in some cases.
Interestingly embedded 32 bit Linux is not tier 1 or 2 though :)
Sure, but I had to look: Tier1: Windows x64/i686, Linux x64/ARM gcc, Darwin/ARM Tier2: Linux x64/ARM w/ clang, Windows ARM, WASM, Darwin/x64 Tier3 is a pretty low support level, but tiers 1 and 2 is a pretty short list…
This is why I strongly like on-call. A lot of people hate it, but if you have a rotation, that will force this person to deal with what they create during their rotations, and the operational issues will be an explicit…
There's also the executive's incentives, and "I'll be gone, you'll be gone": the payoff for that is very long, and it will be hard for them to take credit, and their own tenure might not be as long as that team's.
Nothing here says the data isn't relational. It strongly disagrees, with reasons, why it's not better represented as relational. Personally I prefer the relational stance, and there are a lot of people who don't get it…
> using open weights models AWS and Azure give you the same thing for Claude and ChatGPT, no need to be stuck with open weights. They might sometimes store some of it for other purposes (I don't know the specifics), but…
Or just use Azure, AWS, etc. for Claude/ChatGPT inference, where the AI labs never even get your data in their data centers at all. You pay more for it, but if you care that much, use it.
> There is no similar currency that Nvidia can create ad infinitum. It can create obligations to provide future GPUs in return for present money. Yes at some point people might start to question, but what are the true…
The CHIPS Act in the US did set aside a reserve for older processes used for automobile, defense, and industrial semiconductors - but that's not gaming GPUs that used the previous process node.
NVidia is limited by the number of chips they can produce. If you can fab 1000 chips, and can sell some for $500 and some for $80000 what are you going to do? The game GPU is at once profitable, but causes them to give…
> Do you really want the rust compiler to run at the speed of an llm? That... might actually be an improvement?
> a Jeffreys prior will happen to make it satisfy the definition of a confidence interval as well Correct, which is why it's crazy to consider a Jeffrey's credible interval as valid, but not a confidence interval.…
That's why this paper is important - it shows it isn't trained out. Leaving no other information in the model makes it clear what the biases are, and that the model is willing to make a biased decision. If you give it…
> Maybe their hardware is incapable I am unsure if it is incapable, but it sounds hard. They have tons of cores with 64k of SRAM each, and relatively slow paths in/out. On a GPU you can leave it in SRAM. On Cerebras,…
The insane valuations for selling a dream are what make VC worthwhile. TSLA would be worth crap if it were a private company giving off dividends. It is really truly about the insane valuations driven by collective…
> Something that is sustainable with a small team. These days, it can be sustainable for a tiny team, named Claude and Luna. Why doesn't every engineer have a side project or three for small market things of this…
I would maybe argue that Einstein was the most LLM-like of great thinkers. A lot of his great discoveries were mostly that he was very knowledgeable about the bleeding edge research in a number of disparate areas, and…
What if it can be Einstein, but can't draw a Pelican, write a solid college-level essay, or fold clothes? The ability to do a ton of book learning in training, and pull in tons of related context at once, is superhuman…
It's no different than generally using AWS.
The foundation of the businesses training AI models. So don't use them for inference.
> It's quite shocking to me how many experienced, tech-savvy people, who used to care about cookies and ad tracking - are now willingly sending their business strategies, highly confidential contracts, and intimate…
Are you training something so big you need that much unified RAM though? If you can fit it on a GPU, and especially for training, it is so much quicker than a Mac.
It is a completely comparison for me as a consumer, since they're the costs and benefits that I'll actually get.
> They also have enough power to negotiate contracts with strong privacy provisions. What privacy provisions would you want to add to AWS? Most of the reasonable strong privacy provisions you'd want are already there…
How would this allow compile-time resolution of virtuals that was not possible before? Gcc can already do link-time devirtualization in some cases.
Interestingly embedded 32 bit Linux is not tier 1 or 2 though :)
Sure, but I had to look: Tier1: Windows x64/i686, Linux x64/ARM gcc, Darwin/ARM Tier2: Linux x64/ARM w/ clang, Windows ARM, WASM, Darwin/x64 Tier3 is a pretty low support level, but tiers 1 and 2 is a pretty short list…
This is why I strongly like on-call. A lot of people hate it, but if you have a rotation, that will force this person to deal with what they create during their rotations, and the operational issues will be an explicit…
There's also the executive's incentives, and "I'll be gone, you'll be gone": the payoff for that is very long, and it will be hard for them to take credit, and their own tenure might not be as long as that team's.
Nothing here says the data isn't relational. It strongly disagrees, with reasons, why it's not better represented as relational. Personally I prefer the relational stance, and there are a lot of people who don't get it…