Stable diffusion was a productised version of work done at LMU. Not sure Germany is the best example of how AI funding goes wrong.
https://xcancel.com/RealJosephus/status/1832904398831280448
What is the pass rate on torchbench? This gives a more realistic measure of how good a vendor's pytorch support is. All the big chip startups have their own pytorch compiler that works on the examples they write…
Even after prioritising tensorflow, keras, jax etc., they can still afford to have a very large team working on torch_xla and still hedge their bets with a separate team on torch_mlir.
That might be good enough to get a hardware startup acquired, but not good enough to get major sales. Users want pytorch and negligible switching cost between chips. Bigger problem for startups trying to muscle in on…
Easier said than done. Even with Google level resources, TPU support for pytorch is patchy (https://arxiv.org/abs/2309.07181). Device abstraction is not great, assumes CUDA in unexpected places.
I guess some people who worked on the transputer later went on to design Graphcore's IPU? The architecture looks similar (and Bristol based)
Stable diffusion was a productised version of work done at LMU. Not sure Germany is the best example of how AI funding goes wrong.
https://xcancel.com/RealJosephus/status/1832904398831280448
What is the pass rate on torchbench? This gives a more realistic measure of how good a vendor's pytorch support is. All the big chip startups have their own pytorch compiler that works on the examples they write…
Even after prioritising tensorflow, keras, jax etc., they can still afford to have a very large team working on torch_xla and still hedge their bets with a separate team on torch_mlir.
That might be good enough to get a hardware startup acquired, but not good enough to get major sales. Users want pytorch and negligible switching cost between chips. Bigger problem for startups trying to muscle in on…
Easier said than done. Even with Google level resources, TPU support for pytorch is patchy (https://arxiv.org/abs/2309.07181). Device abstraction is not great, assumes CUDA in unexpected places.
I guess some people who worked on the transputer later went on to design Graphcore's IPU? The architecture looks similar (and Bristol based)