9 ms·
How do you know it swaps to ram vs on the TPU? Would be interested in testing this on my pixel.
by prism56 3mo ago
How do you know it swaps to ram vs on the TPU?
Would be interested in testing this on my pixel.
- netdur 3mo agoBecause TPU has 2GB and weight + context needs more