6 ms·
Not when you consider the sheer amount of compute to calculate a single token. Today, at least. Maybe if we have some breakthrough in how to get equivalent ai
by y1n0 23d ago
Not when you consider the sheer amount of compute to calculate a single token. Today, at least.
Maybe if we have some breakthrough in how to get equivalent ai capacity out of less compute it’ll seem crazy in retrospect.
But the magnitude of flops per token on SOTA models is mind boggling huge.