So difficult to read ..
Maybe OpenAI or Anthropic
It’s very simple. Apple doesn’t pay as well as other places and they stock price increases and their flashiness are not enough anymore to keep people around. It’s time they realize they are not the darling they used to…
No way an offchip HBM has same or better bandwidth then onchip
is this approach viable on training? wat about kernels that require different grids?
What an amazing write up! Thank you very much!
To be clear a cerebras chip is consuming a whole wafer and has only 44 GB of SRAM on it. To fit a 405B model in bf16 precision (excluding kv cache and activation memory usage) you need 19 of these “chips” (and the…
This is supposed to be a product , not a research artifact.
What stops nvidia from making sure this stops working in future driver releases?
To be honest restricting funding to the kind of symbolic based AI research that is criticized in this discussion might have helped AI more than it hurt , by eventually pivoting the research toward neural networks and…
I mean, he was right … for what we knew at that time. He predicted correctly that the only way to achieve a general intelligence it would require to mimic the extremely complex neural networks in our brain that the…
Snaaaake
Whenever I see a product that advertises itself based on the technology it is built on I’m skeptical. Rust doesn’t make a game engine good.
Am I the only one not understanding what’s the point of all these efforts to try to run Linux on completely closed with no documentation devices (like iPhones and even mace for that matter). Seems like a lot of effort,…
This seems specifically designed to make the us look bad. If you try to compare us and Libya it almost seems like it would be so much better to move there which is stupid. Statistics are calculated in such a way that is…
But your really can’t. GDP per capita doesn’t capture so many parameters and conditions (like being landlocked surrounded by wealthy countries that use you as a de-facto tax haven)
Whenever I read articles like “Nordic country succeeds doing X” I always wonder if that would work on a country that is not 6 million people with tons of natural resources available per capita (Oil, timber, ore). Sadly…
Well that’s not how it works. When a company controls a very important piece of something society starts to rely on (oil, information, communication ... etc), regulation is not just preferable . It is NECESSARY.
What are you talking about. A restaurant doesn’t have the power to steer an economy of billions of dollars worldwide (the phone app market) . Apple and google do. Do you understand the risk for countries to allow one…
What about Microsoft and Windows then. People complained to death back in the day for anticompetitive behavior (and were right). The iPhone success is not only Apple’s success. Apple has to thank all the devs that…
This idea that having a separate App Store would completely render the ecosystem a Wild West of standards like Linux is something I never understood. If they allow side loading developers will still stick with the App…
Good try Xi
Amazon’s version of sherlocking
Can it run crysis?
If I was a founder I would certainly try to give to my organization “founder syndrome”. And I’d keep my company private for as much as I could :P
So difficult to read ..
Maybe OpenAI or Anthropic
It’s very simple. Apple doesn’t pay as well as other places and they stock price increases and their flashiness are not enough anymore to keep people around. It’s time they realize they are not the darling they used to…
No way an offchip HBM has same or better bandwidth then onchip
is this approach viable on training? wat about kernels that require different grids?
What an amazing write up! Thank you very much!
To be clear a cerebras chip is consuming a whole wafer and has only 44 GB of SRAM on it. To fit a 405B model in bf16 precision (excluding kv cache and activation memory usage) you need 19 of these “chips” (and the…
This is supposed to be a product , not a research artifact.
What stops nvidia from making sure this stops working in future driver releases?
To be honest restricting funding to the kind of symbolic based AI research that is criticized in this discussion might have helped AI more than it hurt , by eventually pivoting the research toward neural networks and…
I mean, he was right … for what we knew at that time. He predicted correctly that the only way to achieve a general intelligence it would require to mimic the extremely complex neural networks in our brain that the…
Snaaaake
Whenever I see a product that advertises itself based on the technology it is built on I’m skeptical. Rust doesn’t make a game engine good.
Am I the only one not understanding what’s the point of all these efforts to try to run Linux on completely closed with no documentation devices (like iPhones and even mace for that matter). Seems like a lot of effort,…
This seems specifically designed to make the us look bad. If you try to compare us and Libya it almost seems like it would be so much better to move there which is stupid. Statistics are calculated in such a way that is…
But your really can’t. GDP per capita doesn’t capture so many parameters and conditions (like being landlocked surrounded by wealthy countries that use you as a de-facto tax haven)
Whenever I read articles like “Nordic country succeeds doing X” I always wonder if that would work on a country that is not 6 million people with tons of natural resources available per capita (Oil, timber, ore). Sadly…
Well that’s not how it works. When a company controls a very important piece of something society starts to rely on (oil, information, communication ... etc), regulation is not just preferable . It is NECESSARY.
What are you talking about. A restaurant doesn’t have the power to steer an economy of billions of dollars worldwide (the phone app market) . Apple and google do. Do you understand the risk for countries to allow one…
What about Microsoft and Windows then. People complained to death back in the day for anticompetitive behavior (and were right). The iPhone success is not only Apple’s success. Apple has to thank all the devs that…
This idea that having a separate App Store would completely render the ecosystem a Wild West of standards like Linux is something I never understood. If they allow side loading developers will still stick with the App…
Good try Xi
Amazon’s version of sherlocking
Can it run crysis?
If I was a founder I would certainly try to give to my organization “founder syndrome”. And I’d keep my company private for as much as I could :P