volta87

5 ms·

1.
by volta87 3y ago
The arguments in this blogpost are fundamentally flawed. The fact that they opened a bug based on them but got shut down should have raised all red flags. When compiling and running a C program, the only thing that matters is "what the
2.
Nvidia DGX GH200 Whitepaper(resources.nvidia.com)
95 points by volta87 3y ago|43 comments
3.
by volta87 6y ago
From the POV of an HPC cluster user, when using SLURM's `srun` or similar to schedule a job, this now allows you to use `srun --container=<your container>`, and it will start each node where you app run using the container, and m
4.
by volta87 6y ago
In which category is Intel not being outperformed by competitors?
5.
by volta87 6y ago
> can you compile for ARM and move the binary around as easily as you can for x86? Yes.
6.
by volta87 6y ago
And then every time you change a view option at run-time, your `.htoprc` gets modified.....
7.
by volta87 6y ago
The article touches on this, since its an important realization. In C, however, if the integers are not unsigned, the add/sub version exhibits UB on overflow, because C unnecessarily ties signed/unsignedness with overflow behavior
8.
by volta87 6y ago
Memory became less of an issue for me with V100, and isn't really an issue with A100, at least when quickly iterating for newer models, when the sizes are still relatively small.
9.
by volta87 6y ago
The main killer feature for me in the M1 is that it only supports 1 external display, and that the webcam isn't great. I hope they fix those.
10.
by volta87 6y ago
> The challenge is selecting the tests that best represent the typical ML/DL use cases for the M1 and comparing it to an alternative such as the V100 using a common toolchain like Tensorflow. The benchmarks there are actual applicat
11.
by volta87 6y ago
If that's the case that would be very good. One can buy lots of M1 mac minis for the price of a V100..
12.
by volta87 6y ago
Depends on model size, but if the model is small enough that I actually do training on a PCIe board, I do. I partition an A100 in 8, and train 8 models at a time, or just use MPS on a V100 board. The bigger A100 boards can fit multiple of t
13.
by volta87 6y ago
If this happens I might replace my macbook air mid 2012. Magsafe, no touchbar, hopefully 14'' with 32GB of RAM and M1X. Also, I hope a decent webcam, and ability to support at least 2 external displays..
14.
by volta87 6y ago
Even in reinforcement learning you can train multiple model with different data-sets concurrently and combine them for the next iteration.
15.
by volta87 6y ago
> Just look at the result Google gets with BERT on V100s vs the result NVIDIA gets with V100s. These benchmarks measure the combination of hardware+software to solve a problem. Google and NVIDIA are using the same hardware, but their sof
16.
by volta87 6y ago
When developing ML models, you rarely train "just one". The article mentions that they explored a not-so-large hyper-parameter space (i.e. they trained multiple models with different parameters each). It would be interesting to kn
17.
by volta87 6y ago
> We don’t have apples-to-apples benchmarks We do: https://mlperf.org/ Just run their benchmarks. Submitting your results there is a bit more complicated, because all results there are "verified" by independent
18.
by volta87 6y ago
IIUC the goal of the Alabama factory is to work around the existing tarifs on shipping planes to the US. Instead of shipping the planes, Airbus ships the parts, and assembles them in the US, thus avoiding the plane tarifs. So now there are
19.
by volta87 6y ago
> The tariff will have a significant effect on production of the Airbus A320 in Mobile, Alabama, something which Airbus has claimed will only hurt US workers. How will this hurt US workers? Sounds like this is suggesting that either they
20.
by volta87 6y ago
The EU is not a country nor a federation. Companies that want to operate in EU countries need to abide by each countries laws. The EU just provide a minimum set of laws that must be abided by all countries, but that's pretty much it. E
21.
by volta87 6y ago
That's because the company started dying longer ago. Their stock price today is around 30$. In the early 2000s it was around 90$. Also, like the other comment mentioned, HD has been playing a lot of financial tricks over the last 20 ye
22.
by volta87 6y ago
Agreed. The EU tariffs just accelerated HD's decline, but HD dig their own grave long time ago. HD decision of focusing their brand on a "hardcore biker" culture that has failed (and arguably even alienated) younger customers
23.
by volta87 6y ago
I recall that when Trump started taxing European steel, the EU looked for companies in Republican states that were seen positively by Trump supporters and sniped them with extremely specific tariffs. Harley Davidson was one of these compani
24.
by volta87 6y ago
Where do you live ? You are making very bold claims about solar being unreliable, but I'd completely expect reliability of solar to vary significant from one location to another.
25.
by volta87 6y ago
> A lot of software breaks when you're not running 4kb pages. The page size on windows is 64kb as well so portable software already needs to deal with supporting 4kB and 64kB pages.
26.
by volta87 6y ago
> The infinite loop being UB was added because it prevents some important code motion optimizations Which ones? If this optimizations are so important, how come Rust was designed in such a way to make them impossible? Also, how does this
27.
by volta87 6y ago
If by "nothing" you mean "nothing but looping", then yes, you are right. Any loop that "just loops" is doing something by definition: looping.
28.
by volta87 6y ago
Notice that in C and C++ loops that might not terminate are UB, while in Rust they are just infinite loops. So there is a significant difference in semantics between Rust and C/C++ here.
29.
by volta87 6y ago
llvm does support ppc64le cores with VSX extension; if thats what you mean in fact, IBM uses LLVM proper as its own compiler backend for its ppc processors
30.
by volta87 6y ago
There is a big difference between an App showing you some data, and that same app collecting it, sharing it, and linking it to your identity. For example, Google maps could show you your location in a map, without collecting that data about

More ›