12 ms·

they have 2 interfaces each so you typically daisy chain them

• wolttam 21d ago
  That will hurt latency and latency is very important for good tensor-parallelism performance
  • mmastrac 21d ago
    I think I need one now that I have four - reduce is ring-oriented and still works I believe, but IIRC you only get 200gbps if you use _one_ of two connectx ports.
  • deleted 19d ago
    [deleted]