elwypea

6 ms·

1.
by elwypea 1y ago
Stable diffusion was a productised version of work done at LMU. Not sure Germany is the best example of how AI funding goes wrong.
2.
by elwypea 2y ago
https://xcancel.com/RealJosephus/status/1832904398831280448
3.
by elwypea 3y ago
What is the pass rate on torchbench? This gives a more realistic measure of how good a vendor's pytorch support is. All the big chip startups have their own pytorch compiler that works on the examples they write themselves. From what I
4.
by elwypea 3y ago
llama.cpp is not necessary for creating lots of demand for the chip it was originally written for (Apple M1), whereas new hardware vendors need to demonstrate they can plugin to existing tools to generate enough demand to ship in volume.
5.
by elwypea 3y ago
Even after prioritising tensorflow, keras, jax etc., they can still afford to have a very large team working on torch_xla and still hedge their bets with a separate team on torch_mlir.
6.
by elwypea 3y ago
That might be good enough to get a hardware startup acquired, but not good enough to get major sales. Users want pytorch and negligible switching cost between chips. Bigger problem for startups trying to muscle in on LLMs is that there isn&
7.
by elwypea 3y ago
Easier said than done. Even with Google level resources, TPU support for pytorch is patchy ( https://arxiv.org/abs/2309.07181 ). Device abstraction is not great, assumes CUDA in unexpected places.
8.
by elwypea 3y ago
I guess some people who worked on the transputer later went on to design Graphcore's IPU? The architecture looks similar (and Bristol based)