Every major Cloud vendor is trying to develop their custom AI ASIC. Putting Google aside, Amazon has trainium/inferentia, which Anthropic uses quite extensively. Microsoft is doing sth. similar, although they are quite…
I remember Kumo was focusing on GNN when it was founded (Jure's strength back then). Looks like they are pivoting or have pivoted.
If you are not a paying GCP user, there is really no point to even look at Vertex AI. Just stick with AI Studio and the free developer AI along with it; you will be much much happier.
Really appreciate your team's enormous efforts in this direction, not only the cutting edge research (which I don't see OAI/DeepMind publishing any paper on) but aslo making the content more digestible for non-research…
His Alibaba/Arm bets are legendary. Both made $100B+
Housing is definitely not easily affordable. But the other points are valid.
Cool blog
there is limited TPU support in pytorch via torch_xla
When he drops a vid, you don't ask questions. You watch first and then ask questions :)
High-Flyer is pretty damn rich actually. Someone did some calculation and it turns out they are spending ~$200m (somewhere in that range) on 150 employee compensation alone.
prob. not prof; just phd students needs pubs to graduate
Are you comfortable to send your personal/company code data to a Chinese company (ByteDance)?
There are a couple, i.e., OLMo 2
Exactly. Kind of like the old days when they put together a massive amount of commodity CPUs to build search.
GDM is a research lab. They are not set up for production. There are other teams in Alphabet doing productionization stuff.
Large Chinese companies usually have overseas subsidiaries, which can buy H100 GPUs from NVidia
well, is Waymo doing better than the PyTorch-powered Tesla?
Just use Brave. You'll thank me later ...
I was on CPLEX team for a few years. Core developers are all PhDs from Stanford/MIT and etc. So it's very hardcore stuff, no less than AI research. Completely agree that size is not a good proxy for estimating MIP…
The problem is that there is no bette alternative.
Is Clubhouse still alive?
Right, but they can just use Llama/Mistral for free, instead of their inferior models, which I'm sure take quite a bit of resources to train in the first place.
I wonder why companies like IBM are jumping on the LLM bandwagon and training/releasing models that have no chance of competing with Llama/Mistral? To me it just looks like a complete waste of $$ because nobody will use…
It's MQA, documented in the tech report
maybe they are tracking # of accounts for their next raise from VCs
Every major Cloud vendor is trying to develop their custom AI ASIC. Putting Google aside, Amazon has trainium/inferentia, which Anthropic uses quite extensively. Microsoft is doing sth. similar, although they are quite…
I remember Kumo was focusing on GNN when it was founded (Jure's strength back then). Looks like they are pivoting or have pivoted.
If you are not a paying GCP user, there is really no point to even look at Vertex AI. Just stick with AI Studio and the free developer AI along with it; you will be much much happier.
Really appreciate your team's enormous efforts in this direction, not only the cutting edge research (which I don't see OAI/DeepMind publishing any paper on) but aslo making the content more digestible for non-research…
His Alibaba/Arm bets are legendary. Both made $100B+
Housing is definitely not easily affordable. But the other points are valid.
Cool blog
there is limited TPU support in pytorch via torch_xla
When he drops a vid, you don't ask questions. You watch first and then ask questions :)
High-Flyer is pretty damn rich actually. Someone did some calculation and it turns out they are spending ~$200m (somewhere in that range) on 150 employee compensation alone.
prob. not prof; just phd students needs pubs to graduate
Are you comfortable to send your personal/company code data to a Chinese company (ByteDance)?
There are a couple, i.e., OLMo 2
Exactly. Kind of like the old days when they put together a massive amount of commodity CPUs to build search.
GDM is a research lab. They are not set up for production. There are other teams in Alphabet doing productionization stuff.
Large Chinese companies usually have overseas subsidiaries, which can buy H100 GPUs from NVidia
well, is Waymo doing better than the PyTorch-powered Tesla?
Just use Brave. You'll thank me later ...
I was on CPLEX team for a few years. Core developers are all PhDs from Stanford/MIT and etc. So it's very hardcore stuff, no less than AI research. Completely agree that size is not a good proxy for estimating MIP…
The problem is that there is no bette alternative.
Is Clubhouse still alive?
Right, but they can just use Llama/Mistral for free, instead of their inferior models, which I'm sure take quite a bit of resources to train in the first place.
I wonder why companies like IBM are jumping on the LLM bandwagon and training/releasing models that have no chance of competing with Llama/Mistral? To me it just looks like a complete waste of $$ because nobody will use…
It's MQA, documented in the tech report
maybe they are tracking # of accounts for their next raise from VCs