7 ms·

ShardedTensor was merged / subsumed into DTensor: https://dev-discuss.pytorch.org/t/rfc-pytorch-distributedtensor/740 https://dev-discuss.pytorch.org/t/rfc-pyto

by smhx 4y ago

ShardedTensor was merged / subsumed into DTensor: https://dev-discuss.pytorch.org/t/rfc-pytorch-distributedtensor/740 https://dev-discuss.pytorch.org/t/rfc-pytorch-distributedten... Lots of development and traffic happening here: https://github.com/pytorch/tau/ https://github.com/pytorch/tau/

atty 4y ago
Awesome thanks for pointing this out!
baggiponte 4y ago
So is DTensor a Google thing like XLA or more of an open standard?
- learndeeply 4y ago
  Looks like its just a name collision. It's a tensor used in distributed models, thus Distributed Tensor, or DTensor for short.