5 ms·
To my understanding, pyramidal cells are already partially emulated by certain structures of weights. It's not the same as dedicated multi-layer mechanisms outs
by pushfoo 3y ago
To my understanding, pyramidal cells are already partially emulated by certain structures of weights. It's not the same as dedicated multi-layer mechanisms outside the local flow, but that option seems difficult to implement efficiently with current compute technology.
Maybe more VRAM to hold the added inter-layer features would allow it? NVidia seems reluctant or unable to do that on the consumer side. I haven't had time to thoroughly read up on why. All of these seem plausible:
* Offsetting rising per-unit costs from other components
* Intentional market segmentation
* Export restrictions
- KingMob 3y agoI suspect cost/efficiency is a driving factor. Existing layered NN designs seem quite local, with fewer long-range connections than brains have. I'd bet that updating non-local weights increases memory requirements, slows down computation by orders of magnitude, or both.