Its cool, but it goes against the whole optimization that NLP has gone through with BPE and redundancy/repetition in large data in general. Put this on a coding task or English and you will underperform against…
The amount of upselling, extra parts necessary for basic functionality, predatory resin pricing and specific open "modes" that are free to be subjects to amendment by contract makes this seem like a cash grab for…
[dead]
It's more like it doesn't matter if you sell the most organic, free range, ethically sourced, nutritious, tasty ice cream if your competition is allowed to put cocaine in theirs and get all your customers. I am afraid…
Humans are bound by communication overhead and non-market-based incentives. Adding 3x engineers does not do anything. On an average workplace, you have 80-90% of dead weight who shuffle pointless information around and…
You can take the right path and in the end no-one wants to use your product because it's not as engaging. Instagram tried to take the "good" path in 2014 and lost 90% market share to TikTok who attentionmaxxed things.…
Why is #2 important to answer? Was the question of if horses and carriages are important a thing we had to answer? No, it just fell out of it. If human maths is pointless, what is the issue with defunding it?
I think that this was true pre-attention economy. If you look at security incidents and other prod issues, they rarely move the needle today. I work at a hyperscalar and we have been shipping 40% more bugs to prod since…
People are going to be upset about this, but any learning material in this day and age is solely made for your own understanding when writing it. The LLMs can be better teachers and understand your level of need and…
Like the previous commenter said, people have dependents, mortgages, children, partners, etc. Percentually many more are tied up economically with the capital/state than in 1940s Germany. Given the current economic…
This is how I meant it, but the replies above might have attributed this to moral values somehow
I find some irony in that this hyperbolically late-stage neoliberal take is being taken as something I want in all but 2 replies
I think the economically rational choice is re-education of the group into value-providing employment and mass extermination of those that refuse. Otherwise you might end up with disruptive things like protests,…
Neoliberalism is at a state where moral shaming has very little effect. If you shame someone for trying to build a career or better themselves, you are the problem to a bigger extent than the person doing the previously…
After pondering this for a while, I actually agree with this from the principle of community and socials. I have been in 4-5 open source communities where I met a lot of friends, but since LLMs the communities are…
Can you demonstrate your take on 2) happening in practice? - You have tokens priced differently as evident by for example pricing on for example OpenRouter. - You don't reach 100$ of Fable/Mythos output by running…
This again assumes a total monopoly or a cartel which does not exist today
But the AI companies have no access or knowledge of how much value you produce, they would have to calibrate against some average SWE salary and some average productivity which is task-dependent. There is no way for…
I don't really see the bloated-code take here. With this reasoning, there should appear a non-bloated open-source tool that all knowledgeable, smart developers will migrate to in order to get things done faster, and the…
Not sure how productivity and rent capture are connected here. 1) If a firm spends $99k on compute to replace a $100k engineer and produces 5x the output, how is that not a 5x increase in aggregate labor productivity?…
I assumed the comment above is referring to operand dtype and not accumulator dtype since they mentioned ops. In general even for nvfp4 you use fp32 accumulators because you are usually reducing over large Ks which mean…
These number claim 240W locked power draw on 4070: https://github.com/JustAResearcher/gpu-unlock-ada/releases/t...
The repo has fp16 numbers. Also this one for 4070s shows that its for fp8 as well: https://github.com/JustAResearcher/gpu-unlock-ada/releases/t...
Isn't the easier explanation that music/sound/rhythms has a social function for much of human history, and since humans are social creatures, we find safety and meaning in such sounds?
If we ignore the older releases (sonnet 5, etc that exist in that one) and the new models epoch has not benchmarked, we end up with the same order within the noise brackets as in ArtificialAnalysis. I do trust epoch…
Its cool, but it goes against the whole optimization that NLP has gone through with BPE and redundancy/repetition in large data in general. Put this on a coding task or English and you will underperform against…
The amount of upselling, extra parts necessary for basic functionality, predatory resin pricing and specific open "modes" that are free to be subjects to amendment by contract makes this seem like a cash grab for…
[dead]
It's more like it doesn't matter if you sell the most organic, free range, ethically sourced, nutritious, tasty ice cream if your competition is allowed to put cocaine in theirs and get all your customers. I am afraid…
Humans are bound by communication overhead and non-market-based incentives. Adding 3x engineers does not do anything. On an average workplace, you have 80-90% of dead weight who shuffle pointless information around and…
You can take the right path and in the end no-one wants to use your product because it's not as engaging. Instagram tried to take the "good" path in 2014 and lost 90% market share to TikTok who attentionmaxxed things.…
Why is #2 important to answer? Was the question of if horses and carriages are important a thing we had to answer? No, it just fell out of it. If human maths is pointless, what is the issue with defunding it?
I think that this was true pre-attention economy. If you look at security incidents and other prod issues, they rarely move the needle today. I work at a hyperscalar and we have been shipping 40% more bugs to prod since…
People are going to be upset about this, but any learning material in this day and age is solely made for your own understanding when writing it. The LLMs can be better teachers and understand your level of need and…
Like the previous commenter said, people have dependents, mortgages, children, partners, etc. Percentually many more are tied up economically with the capital/state than in 1940s Germany. Given the current economic…
This is how I meant it, but the replies above might have attributed this to moral values somehow
I find some irony in that this hyperbolically late-stage neoliberal take is being taken as something I want in all but 2 replies
I think the economically rational choice is re-education of the group into value-providing employment and mass extermination of those that refuse. Otherwise you might end up with disruptive things like protests,…
Neoliberalism is at a state where moral shaming has very little effect. If you shame someone for trying to build a career or better themselves, you are the problem to a bigger extent than the person doing the previously…
After pondering this for a while, I actually agree with this from the principle of community and socials. I have been in 4-5 open source communities where I met a lot of friends, but since LLMs the communities are…
Can you demonstrate your take on 2) happening in practice? - You have tokens priced differently as evident by for example pricing on for example OpenRouter. - You don't reach 100$ of Fable/Mythos output by running…
This again assumes a total monopoly or a cartel which does not exist today
But the AI companies have no access or knowledge of how much value you produce, they would have to calibrate against some average SWE salary and some average productivity which is task-dependent. There is no way for…
I don't really see the bloated-code take here. With this reasoning, there should appear a non-bloated open-source tool that all knowledgeable, smart developers will migrate to in order to get things done faster, and the…
Not sure how productivity and rent capture are connected here. 1) If a firm spends $99k on compute to replace a $100k engineer and produces 5x the output, how is that not a 5x increase in aggregate labor productivity?…
I assumed the comment above is referring to operand dtype and not accumulator dtype since they mentioned ops. In general even for nvfp4 you use fp32 accumulators because you are usually reducing over large Ks which mean…
These number claim 240W locked power draw on 4070: https://github.com/JustAResearcher/gpu-unlock-ada/releases/t...
The repo has fp16 numbers. Also this one for 4070s shows that its for fp8 as well: https://github.com/JustAResearcher/gpu-unlock-ada/releases/t...
Isn't the easier explanation that music/sound/rhythms has a social function for much of human history, and since humans are social creatures, we find safety and meaning in such sounds?
If we ignore the older releases (sonnet 5, etc that exist in that one) and the new models epoch has not benchmarked, we end up with the same order within the noise brackets as in ArtificialAnalysis. I do trust epoch…