I won't blame Altman here. Memory companies secretly love this. LLM will always be commercialized after people discovered it if it's not Altman it would be another person. And you cannot genuinely say people do not find…
like anyone don't have a 401k, if AI crashes, say goodbye to 401k. This is not really constructive to the situation. What is constructive is thinking about how to improve the country's electricity system, which will…
I feel the same. I feel machine learning is 1) you need strong math knowledge but also intuition. 2) You need actual production level data, a lot of the nuances of machine learning, applied scientists' roles are how to…
could push kv-cache to off chip cheaper storage like dram. Inference engine manages decode for a single user to run to completion before decode a different users so kv-cache fetch from dram to sram is limited.
what about tiling? seems better to call into existing kernels, fused megakernels than rewrite kernel in java.
since openAI and Anthropic are public about their anti-distillation mechanism, its either their anti-distillation doesn't work or kimi got here because their own training and RLs. Which one is it?
more to say US strategy to strangle Chinese economy and technology industry through semiconductor embargo will fail.
these labs have access to far better NVIDIA chips than deepseek
last year was google winning AI, this year is meta winning AI. I think what is true is Meta, Google will all find their place in the AI world and continue to make huge amount of money. A consumer will use many different…
Huawei is launching a mobile soc built with logic folding. They take a single logic ip, like a cpu, and spread it's components across to dies and use hybrid bonding to combine top to bottom. For example the CPU SRAM on…
CSPs making own hardware still needs hardware companies, they reduce the Nvidia tax but still need the likes of TSMC, Broadcom, micron/sk hynix, Marvell, the truth semi-companies. CSPs will not have the patents, IPs and…
China does not want to crash US economy. US economy strong means more purchases for our goods. But US want to crash Chinese economy by: 2018 trade war, 2019 Huawei sanctions, sanctioning at least 1000 large influential…
You need 64 H200 super-node for inference for kimi k3. You will not do inference locally. What might pop the western hardware bubble is Chinese GPU, memory, networking companies. But even in China, these AI centric…
No, Nvidia is worried about Chinese hardware stack. China is under sanction, what are they training and inferencing these models on? Even if this model might still be Nvidia chips, what about the next model. Everyone…
Winners are hardware companies, GPUs,XPUs, HBM, memory, connectivity. Even CSPs are just compute renters, they charge a margin to make sure their hardware purchases can be made back. But given there are more and more AI…
Chinese solar technology is multiple generations ahead of US companies. First solar panels have a conversion rate of 17% while longi is 24.8% and demonstrating 26%. First solar should be out of the market without US…
WS 15 is already shipping with latest J20, its trust to weight ratio is above 10.
CJ1000A is being certified by 2028. It is equivalent to LEAP engines on fuel burn. WS15 and WS19 are all shipping today and have thrust to weight ratio above 10. CJ2000 is a 35-ton trust, genx fuel burn class engine, on…
if you look at the price per gb of memory, at today's prices its only equal to 2014. People don't complain about memory prices back then. The reality is modern world just need much more memory. Before 8GB memory was…
US restriction on China is not just GPU, but total blockade of anything semi related all the way from fab equipment to final chips. Same restriction will work on any other country. But it does not work on China. Not…
Maybe software people can get around this issue by not making every app a electron bloat? This is now more than doable now you got AI right? And it will save your job
cxmt is also selling their memory similar to the big three. No one hardware company in their right mind will sell their products not as high as possible after you learn how much harder hardware engineer and fab people…
if demand is too high, the market will adjust by adding supply. If Apple can't take the price of memory, why don't they make memory themselves. Oh no, the technical and manufacturing know-how is a barrier to entry and…
memory is a commodity is laughable. Then software engineering is even more a commodity, the amount of engineering going into making memory chips the vast majority of people don't understand. There are a lot of software…
And hyper-scalers, Apple, AI labs all will die if memory makers can't sell to them?
I won't blame Altman here. Memory companies secretly love this. LLM will always be commercialized after people discovered it if it's not Altman it would be another person. And you cannot genuinely say people do not find…
like anyone don't have a 401k, if AI crashes, say goodbye to 401k. This is not really constructive to the situation. What is constructive is thinking about how to improve the country's electricity system, which will…
I feel the same. I feel machine learning is 1) you need strong math knowledge but also intuition. 2) You need actual production level data, a lot of the nuances of machine learning, applied scientists' roles are how to…
could push kv-cache to off chip cheaper storage like dram. Inference engine manages decode for a single user to run to completion before decode a different users so kv-cache fetch from dram to sram is limited.
what about tiling? seems better to call into existing kernels, fused megakernels than rewrite kernel in java.
since openAI and Anthropic are public about their anti-distillation mechanism, its either their anti-distillation doesn't work or kimi got here because their own training and RLs. Which one is it?
more to say US strategy to strangle Chinese economy and technology industry through semiconductor embargo will fail.
these labs have access to far better NVIDIA chips than deepseek
last year was google winning AI, this year is meta winning AI. I think what is true is Meta, Google will all find their place in the AI world and continue to make huge amount of money. A consumer will use many different…
Huawei is launching a mobile soc built with logic folding. They take a single logic ip, like a cpu, and spread it's components across to dies and use hybrid bonding to combine top to bottom. For example the CPU SRAM on…
CSPs making own hardware still needs hardware companies, they reduce the Nvidia tax but still need the likes of TSMC, Broadcom, micron/sk hynix, Marvell, the truth semi-companies. CSPs will not have the patents, IPs and…
China does not want to crash US economy. US economy strong means more purchases for our goods. But US want to crash Chinese economy by: 2018 trade war, 2019 Huawei sanctions, sanctioning at least 1000 large influential…
You need 64 H200 super-node for inference for kimi k3. You will not do inference locally. What might pop the western hardware bubble is Chinese GPU, memory, networking companies. But even in China, these AI centric…
No, Nvidia is worried about Chinese hardware stack. China is under sanction, what are they training and inferencing these models on? Even if this model might still be Nvidia chips, what about the next model. Everyone…
Winners are hardware companies, GPUs,XPUs, HBM, memory, connectivity. Even CSPs are just compute renters, they charge a margin to make sure their hardware purchases can be made back. But given there are more and more AI…
Chinese solar technology is multiple generations ahead of US companies. First solar panels have a conversion rate of 17% while longi is 24.8% and demonstrating 26%. First solar should be out of the market without US…
WS 15 is already shipping with latest J20, its trust to weight ratio is above 10.
CJ1000A is being certified by 2028. It is equivalent to LEAP engines on fuel burn. WS15 and WS19 are all shipping today and have thrust to weight ratio above 10. CJ2000 is a 35-ton trust, genx fuel burn class engine, on…
if you look at the price per gb of memory, at today's prices its only equal to 2014. People don't complain about memory prices back then. The reality is modern world just need much more memory. Before 8GB memory was…
US restriction on China is not just GPU, but total blockade of anything semi related all the way from fab equipment to final chips. Same restriction will work on any other country. But it does not work on China. Not…
Maybe software people can get around this issue by not making every app a electron bloat? This is now more than doable now you got AI right? And it will save your job
cxmt is also selling their memory similar to the big three. No one hardware company in their right mind will sell their products not as high as possible after you learn how much harder hardware engineer and fab people…
if demand is too high, the market will adjust by adding supply. If Apple can't take the price of memory, why don't they make memory themselves. Oh no, the technical and manufacturing know-how is a barrier to entry and…
memory is a commodity is laughable. Then software engineering is even more a commodity, the amount of engineering going into making memory chips the vast majority of people don't understand. There are a lot of software…
And hyper-scalers, Apple, AI labs all will die if memory makers can't sell to them?