sakex

7 ms·

1.
by sakex 2mo ago
3% profit margin means you're better off selling the business and investing the cash into US bonds at current rates.
2.
by sakex 3mo ago
Another thing in that vein is features that were built because the previous approach was obtuse. For instance, find it harder to explain async/await in JS to people who never experienced callback hell, or why there is a borrow checker
3.
by sakex 3mo ago
Too much immigration too quick, people got fed up from what I gather
4.
by sakex 3mo ago
I worked at google for 3 years and can confirm what you've heard. Obviously, every org is somewhat different.
5.
by sakex 3mo ago
While I agree we need to keep our immigration under control, this is not the solution.
6.
by sakex 4mo ago
Is this based on paged attention with hashing of the pages?
7.
by sakex 5mo ago
Incredible to see my high school mentioned here
8.
by sakex 5mo ago
Gaming GPUs only which are those we are all nostalgic about, but hardly the ones that matter now for Nvidia.
9.
by sakex 7mo ago
I also bought a laptop with an RTX 5090 (mobile) in New York last month. I paid half what I would have paid in my country. Especially when you consider how low the USD is trading at.
10.
by sakex 9mo ago
Levels in big tech are just a way to keep you motivated. You'll work harder to get a promo. In the end it doesn't matter, you'll make more money by either leaving or getting a retention offer.
11.
by sakex 9mo ago
Exactly like Trump is doing to you.
12.
by sakex 10mo ago
I'd be surprised if they didn't scale it up.
13.
by sakex 1y ago
There are new things being tested and yielding results monthly in modelling. We've deviated quite a bit from the original multi head attention.
14.
by sakex 1y ago
Maybe add the date to the title, because it's hardly new at this point
15.
by sakex 1y ago
What about MRI? Just had one. Sorry if it's a stupid question, I don't know much about this
16.
by sakex 1y ago
The anomaly here are AI researchers
17.
by sakex 2y ago
> They won’t notice those extra 10 milliseconds you saved Depends what you're doing. In my case I'm saving microseconds on the step time of an LLM used by hundreds of millions of people.
18.
by sakex 2y ago
The point you're missing is that people were making the same kind of comments about Amazon and Uber not too long ago
19.
by sakex 2y ago
I was laid off from Google in January last year alongside 150 people in my extended team. I managed to find a different team in Gemini, so now I'm part of Deepmind. I have very conflicting feelings because on one hand I really enjoy th
20.
by sakex 2y ago
> I have some doubt about #2. Weren't Big Tech companies paying senior engineers $300K+ - in 2025-adjusted dollars - back in 2013? Yes but big tech got bigger. Google had a 4th of its current workforce for instance, Meta a 10th, etc
21.
by sakex 2y ago
Such an accurate description of what I went through in Switzerland. Kids are mean, and I had to be mean to survive too. It stained my character in ways I am still trying to overcome more than a decade later.
22.
by sakex 2y ago
Name and shame
23.
by sakex 2y ago
That's something I wish I had when I started looking at einsums. It gets interesting when you start thinking about optimum paths (like in the opt_einsum package), sharded/distributed einsums, and ML accelerators.
24.
by sakex 2y ago
I have a hard time imagining who would suffer from this more, but I have an even harder time imagining anyone would benefit from this.
25.
by sakex 2y ago
Great article. I think what you should cover next is collective matmuls and sharding.
26.
by sakex 2y ago
Using Jax, you should be able to get good performance out of the box
27.
by sakex 2y ago
Shameless plug: I have an implementation in Rust (CPU only) with added GRU gates https://crates.io/crates/neat-gru
28.
by sakex 2y ago
I agree to some extent, but I'd say it depends on the programming language. For instance, in Python, you absolutely need documentation because you don't know what type is expected, what different values can be passed or even the o
29.
by sakex 2y ago
Jax is really nice
30.
by sakex 2y ago
There is no preemption in Javascript. It is based on cooperative multitasking[1] (your await statements and non-blocking callback) which is the opposite of preemption. [1] https://en.wikipedia.org/wiki/Cooperative_multit

More ›