6 ms·
I was going to make a pedantic argument/joke about memoization. It is kind of an interesting thought though. A big wall of SSD is a fabulous amount of storage.
by jfoutz 2y ago
I was going to make a pedantic argument/joke about memoization.
It is kind of an interesting thought though. A big wall of SSD is a fabulous amount of storage. and maybe a clever read only architecture, would be cheaper than SSD. and a clever data structure for shared high order bits, maybe, maybe there is potential for some device to look up matrix multiply results, or close approximations that could be cheaply refined.
Right now, I doubt it. But big static cache it is a kind of interesting idea to kick around Saturday afternoon.
- rbanffy 2y ago> maybe there is potential for some device to look up matrix multiply results, or close approximations that could be cheaply refined. Shard that across the planet and you'd have a global cache for calculations. Or a lookup for every possible AI prompt and its results.
- marcosdumay 2y ago> I was going to make a pedantic argument/joke about memoization. You are reading the GP the wrong way around. You store partial results exactly because you can't store computation. Computation is perishable¹, you either use it or lose it. And one way to use it is to create partial results you can save for later. 1 - Well, partially so. Hardware utilization is perishable, but computation also consumes inputs (mostly energy) that aren't. How much it perishable depends on the ratio of those two costs, and your mobile phone has a completely different outlook from a supercomputer.