saiojd

10 ms·

1.
by saiojd 2y ago
Plenty of people are already miserable. Might as well try if you are no?
2.
by saiojd 3y ago
What does __syncthreads() do here exactly? I'm new to CUDA, could get the overall idea of the FlashAttention paper but not the details.
3.
by saiojd 3y ago
I would guess, to make sure the classic noob mistake of typing `if x = 3:` instead of `if x == 3:` stays a syntax error
4.
by saiojd 3y ago
I had missed this message but have to say I love the expression "orthogonal nightmares", really captures it well :)
5.
by saiojd 3y ago
If this happens we will just get more things done with the same amount of compute (see: Blinn's law). The demand for GPUs does not really come from algorithmic compute requirements but from social expectation of progress in the field o
6.
by saiojd 3y ago
Javascript's package management is so much better than Python's IMO...
7.
by saiojd 3y ago
Most papers already have code, and videos are very common.
8.
by saiojd 3y ago
I understand better what you mean now. Clearly you've thought about this topic more than I have, so I don't think I can contribute much to the conversation unfortunately. "It still has to deliver value in return for the value
9.
by saiojd 3y ago
I don't see your point, to be honest. This US government could easily afford to host Reddit. The reasons it does not are cultural, not economic.
10.
by saiojd 3y ago
That's a fair point about allowing competition. But frankly, it just sucks that Reddit choses to purposefully hurt its service. With social media, there's also a strong moating effect that is fundamentally anti-competitive.
11.
by saiojd 3y ago
I'm not the type to hate on capitalism but Reddit's management is truly capitalism gone wrong. Ruining a public service for the profits of a few. What a waste.
12.
by saiojd 3y ago
Thanks for the info. I didn't know about the TomeSD stuff, really interesting. Why do you think that AITemplate is so much faster?
13.
by saiojd 3y ago
I find you post intriguing. What would you say are the major janks with torch.compile, and what issues are addressed by TVM/AITemplate but not by torch.compile? EDIT: If I understand correctly these libraries target deployment performa
14.
by saiojd 3y ago
Not to dismiss the guts of these explorers, but we have not been to the Moon in 50 years because it costs a fortune to get to when it's not much more than a floating rock (I'm being hyperbolic but the point is that there is no eco
15.
by saiojd 3y ago
`with` blocks in Python become very ugly when nested, I'm glad it's a single line personally
16.
by saiojd 3y ago
To me it seems like disposing of the object being destructured is the natural solution. But I can see where others will disagree.
17.
by saiojd 3y ago
I agree. I feel like `using async x = ...` would read much more nicely and avoid the confusion.
18.
by saiojd 3y ago
That's strange, what's the motivation behind not allowing destructuring? Seems very prudish.
19.
by saiojd 3y ago
Imagine that resource inherits from a class with an existing method called dispose. What happens then?
20.
by saiojd 3y ago
Saccadic masking probably comes into play: https://en.wikipedia.org/wiki/Saccadic_masking (brains "drops frames" while the eyes move, so "popping" during eye movement probably won't be percepti
21.
by saiojd 3y ago
What kind of bagel?
22.
by saiojd 3y ago
I see your point. I just went over the abstract again and I totally agree.
23.
by saiojd 3y ago
While I agree that the claims are hyperbolic, I think you are approaching this paper from the point of view of someone who knows a lot about sorting. Because of this, its normal that the claims of these guys who probably don't know muc
24.
by saiojd 3y ago
Sure, but the whole point is to reduce this kind of search to RL, which is a very general framework. Their paper shows that such a generic approach can solve a very specific problem, and solve it well. But, their paper is about improving RL
25.
by saiojd 3y ago
I feel like your take is overly cynical. The fact that humans can do the same thing by hand is not really the point. The contribution lies in the fact that their method derived this improvement *automatically*, which is where the impact lie
26.
by saiojd 3y ago
Very interesting point! Hopefully its not the case so the trend can continue...
27.
by saiojd 3y ago
The researchers want credit for their work. Google wants to stay ahed of their competitors. Google has three moves: 1) Allow publishing everything including source code => this helps the competitor directly. Bad move. 2) Disallow publish
28.
by saiojd 3y ago
Yes! It's getting close, but we are still far from things being convenient and widely adopted
29.
by saiojd 3y ago
Which part of their promotion do you find toxic?
30.
by saiojd 3y ago
Awesome :D Really nice project by the way

More ›