5 ms·
> TPU 8i pairs 288 GB of high-bandwidth memory with 384 MB of on-chip SRAM Wow. Just Wow. I presume that's for each chip, and there are 1152 chips in a pod s
by smlacy 5mo ago
> TPU 8i pairs 288 GB of high-bandwidth memory with 384 MB of on-chip SRAM
Wow. Just Wow. I presume that's for each chip, and there are 1152 chips in a pod so that's 331TB HBM and 442TB SRAM per pod. Just wow.
- manquer 5mo agoThat would be 442GB not TB of SRAM. Aggregating on-chip SRAM is not a useful metric. AFAIK there are no interconnect between two chips at SRAM level so they cannot be shared .