5 ms·
The System Requirements on this page say 64GB RAM is a prerequisite on the host system. Why? Wouldn’t an inference server be barebones aside from the Inferenc
by binarymax 3y ago
The System Requirements on this page say 64GB RAM is a prerequisite on the host system. Why? Wouldn’t an inference server be barebones aside from the Inference hardware?
https://tenstorrent.com/cards/ https://tenstorrent.com/cards/
- camel-cdr 3y agoFrom the tenstorrent discord: > It has more to do with the memory resources required during model compilation. The requirement will vary from model to model, so 64GB is a safe limit for all.
- VHRanger 3y agoAnd why do they specify PCIe 4.0? I imagine it's just to leverage bandwidth correctly? Or is there a necessary feature in there?
- deleted 3y ago[deleted]