5 ms·
Have you looked into TinyCorp [0]/tinygrad [1], one of the latest endeavors by George Hotz? I've been pretty impressed by the performance. [2] [0] https://tiny
by jwuphysics 2y ago
Have you looked into TinyCorp [0]/tinygrad [1], one of the latest endeavors by George Hotz? I've been pretty impressed by the performance. [2]
[0] https://tinygrad.org/ https://tinygrad.org/
[1] https://github.com/tinygrad/tinygrad https://github.com/tinygrad/tinygrad
[2] https://x.com/realGeorgeHotz/status/1800932122569343043?t=Y6zE71-DHpFvWNdCvlHgVw&s=19 https://x.com/realGeorgeHotz/status/1800932122569343043?t=Y6...
- arghwhat 2y agoHe also shakes his fist at the software stack, but loudly enough that it has AMD react to it.
- anthonix1 2y agoI have not been impressed by the perf. Slower than PyTorch for LLMs, and PyTorch is actually stable on AMD (I've trained 7B/13B models).. so the stability issues seem to be more of a tinygrad problem and less of an AMD problem, despite George's ramblings [0][1] [0] https://github.com/tinygrad/tinygrad/issues/4301 https://github.com/tinygrad/tinygrad/issues/4301 [1] https://x.com/realAnthonix/status/1800993761696284676 https://x.com/realAnthonix/status/1800993761696284676