sakras

6 ms·

1.
by sakras 3mo ago
Neural accelerators are easy to use from Metal. They kick in automatically if you do a matmul using Metal Performance Primitives and you use bf16 or smaller (they don't seem to work in fp32).
2.
by sakras 7mo ago
Yeah I kind of think authors didn't conduct a thorough-enough literature review here. There are well-known relations between number of hash functions you use and the FPR, cache-blocking and register-blocking are classic techniques (Cac
3.
by sakras 7mo ago
Have you tried SolveSpace? It's easily my favorite open source CAD program. The main things it's missing are shells, fillets, and chamfers. But I've been able to 3D print quite a few parts using it!
4.
by sakras 1y ago
Giving it a quick look, seems like they've addressed a lot of the shortcomings of Parquet which is very exciting. In no particular order: - Parquet metadata is Thrift, but with comments saying "if this field exists, this other fie
5.
by sakras 1y ago
I see you guys are using Egg/Egglog! I've been mildly interested in egraphs for quite a while, glad to see they're gaining traction!
6.
by sakras 1y ago
Likely performance - LLVM is somewhat notorious for being slower than ideal.
7.
by sakras 1y ago
Likely refers to Machine IR, a lower level representation that normal LLVM IR lowers to?
8.
by sakras 1y ago
Typically requests are binned by context length so that they can be batched together. So you might have a 10k bin and a 50k bin and a 500k bin, and then you drop context past 500k. So the costs are fixed per-bin.
9.
by sakras 1y ago
I intuitively think about linear regression as attaching a spring between every point and your regression line (and constraining the spring to be vertical). When the line settles, that's your regression! Also gives a physical intuition
10.
by sakras 1y ago
Maybe I'm missing something, but why do people expect PoW to be effective against companies who's whole existence revolves around acquiring more compute?
11.
by sakras 2y ago
New smart grids with new software do not require a rewrite!
12.
by sakras 2y ago
I've been beating the drum about this to everyone who will listen lately, but I'll beat it here too! Why don't we use seL4 for everything? People are talking about moving to a smart grid, having IoT devices everywhere, puttin
13.
by sakras 2y ago
> Sure, we don’t produce anything, but we have companies with high revenues and we can raise money based on those revenues. We’ll both be rich! I think this is the central hole in the argument that the US is stagnant. The money that inve
14.
by sakras 2y ago
> epoll is threaded, not multiprocess epoll is orthogonal to threads. It _can_ be used in a multithreaded program, but it doesn't have to be. It may very well be implemented in terms of kernel threads, but that's not what I&#x2
15.
by sakras 2y ago
Conceptually yes, but I suspect there's going to be a lot hairier in practice. For instance, I think there's some stuff that needs language support such as thread-local storage. I'd guess it would be simpler to just re-implem
16.
by sakras 2y ago
Maybe I'm misunderstanding something, but it seems like ev is still multiprocessing? Reading the code, it looks like you can read/write to files, and if you want to kick off some other work it spawns a process. I don't see an
17.
by sakras 2y ago
I was pretty excited about Hare until Devault said that Hare wouldn't be doing multithreading as he preferred multiprocessing. That was a pretty big dealbreaker for me. The rest of the language looks quite clean though!
18.
by sakras 2y ago
> Tensor Evolution (TeV) Oh no, I'm never not going to read this as "tera-electron Volts". I wish they picked a different acronym!
19.
by sakras 2y ago
Ah interesting! I've definitely seen some French code somewhere with the variable names being all French as well, so it really was strange to see them be mixed.
20.
by sakras 2y ago
From what I’ve seen, code usually comes in one of two languages: English or French. Somehow everyone but the French speaks enough English to write code!
21.
by sakras 2y ago
> A statement like this pretty much disqualifies your opinions This is needlessly aggressive. I specialize in writing SIMD code. That is my job. I am very eager to get my hands on a RVV chip so that I can play with a new SIMD ISA. So obv
22.
by sakras 2y ago
Oh that's exciting, I will be on the lookout for that!
23.
by sakras 2y ago
I was going to buy one of these until I realized it didn't have vector extensions. I expected something with "Performance" and "Premier" in the name to have them. I think some sort of SIMD capability is table stakes
24.
by sakras 2y ago
Maybe I missed it, but are there any performance numbers? It being 100% implemented in Python makes me very suspicious that this won’t scale to any kind of large robot.
25.
by sakras 2y ago
Just as a data point, I'd recommend going through it in Racket, which I believe has an explicit SICP mode. I went through it in GNU Guile and it was a pain because there were some minor syntactic differences between Guile and MIT Schem
26.
by sakras 2y ago
This has definitely been an issue for me before, I think at least for a while Ubuntu/Debian didn't ship gdb with tui enabled, you had to build it yourself.
27.
by sakras 2y ago
Yep it just uses Jax to do the inference, no tensorflow needed.
28.
by sakras 2y ago
Indeed it's a woodworking technique called Sashimono which doesn't use any glue or screws, just precise cuts to join wood together.
29.
by sakras 2y ago
I spent a long time trying to do some sort of machine learning over the OpenBCI helmet's data with the eventual goal of moving a cursor, but I didn't seem to get anywhere. The data was indeed _extremely_ noisy, and I don't be
30.
by sakras 2y ago
> Though APL may strike some as a strange language of choice for deep learning I've actually spent the better part of last year wondering why we _haven't_ been using APL for deep learning. And actually I've been wondering

More ›