ajtulloch

7 ms·

1.
by ajtulloch 2y ago
- https://www.cs.utexas.edu/users/flame/laff/pfhp/index.html (e.g. here https://www.cs.utexas.edu/users/flame/laff/pfhp/week2-blocki... ) - https://gist.git
2.
by ajtulloch 3y ago
It's quite unfavorable on modern hardware. A Sapphire Rapids core can do 2 separate 32 half-precision FMAs (vfmadd132ph, [1]) per clock, which is 128 FLOPs/cycle. It is not possible to achieve that kind of throughput with an 8-bit
3.
by ajtulloch 3y ago
There’s a big long list of these in https://web.math.princeton.edu/generals/ , not just Tao’s.
4.
by ajtulloch 3y ago
I think the mathematical concept that you are looking for is that of the dual space. Essentially if you have a vector space V, you can construct a dual space V* where the elements of the dual space are functions taking elements of V to the
5.
by ajtulloch 3y ago
One way to view this formula is to use the fact that the Beta distribution is a conjugate prior for the binomial distribution. Essentially if you have a Beta(a, b) prior then your prior mean is a/(a+b) and after observing n samples fro
6.
by ajtulloch 3y ago
https://www.inference.org.uk/itprnn/book.pdf is a classic text on this connection.
7.
by ajtulloch 3y ago
You're probably thinking of https://en.wikipedia.org/wiki/Oliver_Cromwell and not https://en.wikipedia.org/wiki/Thomas_Cromwell .
8.
by ajtulloch 3y ago
https://github.com/facebook/folly/blob/main/folly/docs/Synch...
9.
by ajtulloch 4y ago
https://quantian.substack.com/p/from-trinity-to-liquidity is an excellent example of applying this idea to the problem of inferring the yield of a nuclear explosion and price impact of a trade in an order book.
10.
by ajtulloch 4y ago
“Fast Search in Hamming Space with Multi-Index Hashing” ( https://www.cs.toronto.edu/~norouzi/research/papers/multi_in... ) is a great paper. Note that you can do significantly better (in terms of query latency
11.
by ajtulloch 4y ago
TF32 is not IEEE-754 float32, it is a reduced precision format designed for machine learning usecases. The correct specsheet number for FP32 (and FP64 which is the relevant precision here) throughput on H100 is more like 60TFLOP/s, so
12.
by ajtulloch 4y ago
https://news.ycombinator.com/item?id=7266618
13.
by ajtulloch 5y ago
The GotoBLAS paper (“Anatomy of High-Performance Matrix Multiplication”, https://www.cs.utexas.edu/users/flame/pubs/GotoTOMS_final.pd... ) is really a masterpiece. It’s worth internalizing almost every single
14.
by ajtulloch 5y ago
[flagged]
15.
by ajtulloch 5y ago
I think the two key texts here are Graeber’s Bullshit Jobs and Mark Fisher’s Capitalist Realism, specifically his riff on “market Stalinism”: > The idealized market was supposed to deliver ‘friction free’ exchanges, in which the desires
16.
by ajtulloch 5y ago
If you see his job to be at the cutting edge of Ruy/Marshall/anti-Marshall the results of games 1-6 suggest he’s done a phenomenal job.
17.
by ajtulloch 5y ago
https://rigtorp.se/notes/hashing/ and links therein ( https://github.com/martinus/better-faster-stronger-mixer ) are almost certainly preferable to this mixer.
18.
by ajtulloch 5y ago
Good news! https://pytorch.org/docs/stable/notes/hip.html
19.
by ajtulloch 5y ago
and he's a genius!
20.
by ajtulloch 5y ago
For folks wondering about applications of this theorem: it is a key building block in the theory of reproducing kernel Hilbert spaces (RKHS), which in turn are the building block of kernel support vector machines (kernel SVMs), which are wi
21.
by ajtulloch 5y ago
Underappreciated fact - the Apple SoCs since A10 (iPhone 7, etc) are also big.LITTLE designs! https://en.m.wikipedia.org/wiki/Apple_A10
22.
by ajtulloch 6y ago
A bit petty, but the first example is an unstable softmax implementation: defn softmax(t) do Nx.exp(t) / Nx.sum(Nx.exp(t)) end See https://ogunlao.github.io/2020/04/26/you_dont_really_know_so
23.
by ajtulloch 6y ago
The OP article was submitted on Mon, 30 Nov 2020 23:02:47 - the arXiv identifier 2012.xyz means it was published in the 12th month of 2020, not 2012.
24.
by ajtulloch 6y ago
For everyone saying "oh wow, we can go back to SVMs now, huge speedups, etc" - that's more than a little premature. This is purely a formal equivalence, but not very useful computationally. The math here is pretty much first-
25.
by ajtulloch 6y ago
Awesome work Marat.
26.
by ajtulloch 6y ago
This sucks! Please don’t standardize this.
27.
by ajtulloch 6y ago
> St. Petersburg in revolt gave us Vladimir Nabokov, Isaiah Berlin and Ayn Rand. The first was a novelist, the second a philosopher. The third was neither but thought she was both. Many other people have thought so too. In 1998 readers r
28.
by ajtulloch 6y ago
The entire Landscape series from Macfarlane: - Mountains of the Mind (a history and first-person account of mountain climbing) - The Wild Places (a history and exploration of the 'wild' landscapes of the British Isles) - The Old W
29.
by ajtulloch 6y ago
Lots of companies use BT in a datacenter environment to efficiently distribute binaries to a large number of hosts.
30.
by ajtulloch 6y ago
I watched the documentary last night and it was fantastic. Wonderful work and thank you.

More ›