This is Matt Levine's theory of "everything is securities fraud". Something bad happens, stock goes down, angry shareholders sue because they should have been told the bad thing would happen and the stock would go down.
I'm sure both of the cases I'm thinking of could have been tuned better. Just saying that it's a default case that I've seen 2 places land, both of which had a lot of smart engineers following best practices. Maybe its…
It's not about how good or bad the AI writing is. It's about the human interaction, if someone outsourced their thinking to AI then they are bullshitting me and I will rate their thoughts appropriately at the human…
It's about effort into thinking. If no effort went into either thinking or writing, then I'll plead guilty to sweat of the brown doctrine. Again, Just send me the prompt and I'll feed it to AI myself.
That's a little metaphysical for my taste. If its the same bytes of text, provenance is destroyed anyways, so who knows if the tree fell in the forest. "Substantially" to me would mean not your ideas and not your…
If its substantially AI generated then it's definitionally rubbish, even if it was a good answer to the prompt. I can send a prompt myself, don't waste my time republished AI amswers.
Speculative decoding is software, though. How do you work around the memory wall when you're going to have to stream all weights, no matter what? Latency-hiding tricks don't matter when you're bandwidth constrained.
A couple data points, I like Java but I've seen metrics of container fleets at multiple companies that were memory constrained with low CPU usage sitting around underutilized. The reason in both cases was a bunch of…
Soviet Russia and early communist China both went from mostly-illiterate peasant economies to mostly-literate, partially industrialized, with home-grown heavy industry and weapons technology in the span of like 15-20…
KV cache is per conversation, I'm getting 100% hit rate on my single tenant local set up. The benefits of scale are on the token generation side, you can batch rounds and generate tokens for multiple conversations per…
It's not even a person, it's a system. There's a million people behind you who will take your job if you don't grind, and that goes for your boss as well.
The usage of Neijuan as I understand it isn't about a complete lack of results, Chinese test scores are really good, but there's only 10% in the top 10% so competing even harder just means everyone is miserable…
In China, one could look at hours of homework, work hours etc and conclude there's a reason the term was coined.
Numbers aside, SpaceX has a technological lead. They're not strangling competitors in a commodity business with monopoly practices. I wouldn't call ASMR or TSMC monopolies either, anyone can compete with them in theory.…
Defending standard oil is an all-timer hot take. They only had 90% market share? In a commodity? SpaceX isn't a monopoly because they have domestic and international competition. Before they showed up, ULA was a…
Standard oil is the textbook example of an abusive monopoly and was broken up for that reason. They improved efficiency by cutting exclusive deals with railroads and transport companies due to their size which froze out…
Speaking for China specifically, and this is all word of mouth since my kids are at a posh international school (apply hate appriopriately): Elementary school is 8-5, longish day but not too bad on homework. Middle…
Living in one Asian country, phone scrolling still happens with adults but kids get a lot of homework and definitely do it. Honestly excessive amounts, quantity over quality but at least studying is happening. If some…
Yup, and additionally said stooge would probably be optimizing for their own position and package in a way Zuck doesn't have to. There's a whole new category of selfishness and shortsightedness out there.
If colloquial usage of "anarchy" has a different definition than, an, I'm sorry, irrelevant niche political movement, then you should assume a given speaker meant the colloquial form.
If we abandon the moral "should", then the right move is to shake down Google along the lines I already said. Google should, as a rational actor, pay out better for legitimate vulnerabilities that pose actual risk to…
That's one of the points, yes, but the black market doesn't dictate the value of the exploit to Google. A hardline bargaining position with Google would be more like "pay me what I want, or else I'll give it to all…
That's really informative but maybe a little overly capitalist-brained. We shouldn't look to the black market as cost discovery for these vulnerabilities, most non-criminal researchers are not putting up an ask order…
For qwen, it's an additional transformer layer at the very back, it ships as part of the model.
I find mtp=3 does well with that model, only at 4 it becomes unprofitable. Check your quants, its worth having the mtp layer be a bigger quant if it leads to 2x throughput from more accepted tokens.
This is Matt Levine's theory of "everything is securities fraud". Something bad happens, stock goes down, angry shareholders sue because they should have been told the bad thing would happen and the stock would go down.
I'm sure both of the cases I'm thinking of could have been tuned better. Just saying that it's a default case that I've seen 2 places land, both of which had a lot of smart engineers following best practices. Maybe its…
It's not about how good or bad the AI writing is. It's about the human interaction, if someone outsourced their thinking to AI then they are bullshitting me and I will rate their thoughts appropriately at the human…
It's about effort into thinking. If no effort went into either thinking or writing, then I'll plead guilty to sweat of the brown doctrine. Again, Just send me the prompt and I'll feed it to AI myself.
That's a little metaphysical for my taste. If its the same bytes of text, provenance is destroyed anyways, so who knows if the tree fell in the forest. "Substantially" to me would mean not your ideas and not your…
If its substantially AI generated then it's definitionally rubbish, even if it was a good answer to the prompt. I can send a prompt myself, don't waste my time republished AI amswers.
Speculative decoding is software, though. How do you work around the memory wall when you're going to have to stream all weights, no matter what? Latency-hiding tricks don't matter when you're bandwidth constrained.
A couple data points, I like Java but I've seen metrics of container fleets at multiple companies that were memory constrained with low CPU usage sitting around underutilized. The reason in both cases was a bunch of…
Soviet Russia and early communist China both went from mostly-illiterate peasant economies to mostly-literate, partially industrialized, with home-grown heavy industry and weapons technology in the span of like 15-20…
KV cache is per conversation, I'm getting 100% hit rate on my single tenant local set up. The benefits of scale are on the token generation side, you can batch rounds and generate tokens for multiple conversations per…
It's not even a person, it's a system. There's a million people behind you who will take your job if you don't grind, and that goes for your boss as well.
The usage of Neijuan as I understand it isn't about a complete lack of results, Chinese test scores are really good, but there's only 10% in the top 10% so competing even harder just means everyone is miserable…
In China, one could look at hours of homework, work hours etc and conclude there's a reason the term was coined.
Numbers aside, SpaceX has a technological lead. They're not strangling competitors in a commodity business with monopoly practices. I wouldn't call ASMR or TSMC monopolies either, anyone can compete with them in theory.…
Defending standard oil is an all-timer hot take. They only had 90% market share? In a commodity? SpaceX isn't a monopoly because they have domestic and international competition. Before they showed up, ULA was a…
Standard oil is the textbook example of an abusive monopoly and was broken up for that reason. They improved efficiency by cutting exclusive deals with railroads and transport companies due to their size which froze out…
Speaking for China specifically, and this is all word of mouth since my kids are at a posh international school (apply hate appriopriately): Elementary school is 8-5, longish day but not too bad on homework. Middle…
Living in one Asian country, phone scrolling still happens with adults but kids get a lot of homework and definitely do it. Honestly excessive amounts, quantity over quality but at least studying is happening. If some…
Yup, and additionally said stooge would probably be optimizing for their own position and package in a way Zuck doesn't have to. There's a whole new category of selfishness and shortsightedness out there.
If colloquial usage of "anarchy" has a different definition than, an, I'm sorry, irrelevant niche political movement, then you should assume a given speaker meant the colloquial form.
If we abandon the moral "should", then the right move is to shake down Google along the lines I already said. Google should, as a rational actor, pay out better for legitimate vulnerabilities that pose actual risk to…
That's one of the points, yes, but the black market doesn't dictate the value of the exploit to Google. A hardline bargaining position with Google would be more like "pay me what I want, or else I'll give it to all…
That's really informative but maybe a little overly capitalist-brained. We shouldn't look to the black market as cost discovery for these vulnerabilities, most non-criminal researchers are not putting up an ask order…
For qwen, it's an additional transformer layer at the very back, it ships as part of the model.
I find mtp=3 does well with that model, only at 4 it becomes unprofitable. Check your quants, its worth having the mtp layer be a bigger quant if it leads to 2x throughput from more accepted tokens.