7 ms·
It *should* but I haven't tried it. I will try it. Updated in this issue: We could also try raspberry pi + coral usb tpu (https://coral.ai/products/ https://co
by alexandercheema 2y ago
It *should* but I haven't tried it. I will try it. Updated in this issue:
We could also try raspberry pi + coral usb tpu (https://coral.ai/products/ https://coral.ai/products/) - that might be a killer combo for super cheap home ai cluster.
- alexandercheema 2y agoIssue link: https://github.com/exo-explore/exo/issues/11 https://github.com/exo-explore/exo/issues/11
- yjftsjthsd-h 2y ago> coral usb tpu I thought those were so memory limited that there was no useful way to run an LLM on them?