5 ms·
Google’s TPU’s are not powering Gemini or whatever X equivalent LLM you want to compare to.
by apfsx 10mo ago
Google’s TPU’s are not powering Gemini or whatever X equivalent LLM you want to compare to.
- rdudek 10mo agoWhat is powering Gemini?
- jsolson 10mo agoTPUs: https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-Pro-Model-Card.pdf https://storage.googleapis.com/deepmind-media/Model-Cards/Ge...
- rfw300 10mo agoThis isn't true. Gemini is trained and run almost entirely on TPUs. Anthropic also uses TPUs for inference, see, e.g., https://www.anthropic.com/news/expanding-our-use-of-google-cloud-tpus-and-services https://www.anthropic.com/news/expanding-our-use-of-google-c... and https://www.anthropic.com/engineering/a-postmortem-of-three-recent-issues https://www.anthropic.com/engineering/a-postmortem-of-three-.... OpenAI also uses TPUs for inference at least in some measure: https://x.com/amir/status/1938692182787137738?t=9QNb0hfaQShWoB65AeyWvw&s=19 https://x.com/amir/status/1938692182787137738?t=9QNb0hfaQShW....
- skirmish 10mo agoI can assure you that most internal ML teams are using TPUs both for training and inference, they are just so much easier to get. Whatever GPUs exist are either reserved for Google Cloud customers, or loaned temporarily to researchers who want to publish easily externally reproducible results.
- stingraycharles 10mo agoThey are, even Apple famously uses Google Cloud for their cloud based AI stuff solely because of Apple not wanting to buy NVidia. Google Cloud does have a lot of NVidia, but that’s for their regular cloud customers, not internal stuff.
- jsolson 10mo agoThis comment is incorrect: https://storage.googleapis.com/deepmind-media/Model-Cards/Gemini-3-Pro-Model-Card.pdf https://storage.googleapis.com/deepmind-media/Model-Cards/Ge...