I plan to buy a DGX Spark, so this was a very useful read. Interesting to learn that a 128GB-class device doesn't really give you the full memory budget for mod

I plan to buy a DGX Spark, so this was a very useful read. Interesting to learn that a 128GB-class device doesn't really give you the full memory budget for models once you account for CUDA overhead.