fnbr

6 ms·

1.
by fnbr 10mo ago
(I'm a researcher on Olmo.) There's a bunch of other fully open models, including the [Marin]( https://marin.community/ ) series of models out of Stanford and Nvidia regularly releases fully open models.
2.
by fnbr 10mo ago
MoEs have a lot of technical complexity and aren't well supported in the open source world. We plan to release a MoE soon(ish). I do think that MoEs are clearly the future. I think we will release more MoEs moving forward once we have
3.
by fnbr 10mo ago
(I’m a researcher on the post-training team at Ai2.) Where did you try this? On the Ai2 playground?
4.
by fnbr 10mo ago
(I’m a researcher on the post-training team at Ai2.) 7B models are mostly useful for local use on consumer GPUs. 32B could be used for a lot of applications. There’s a lot of companies using fine tuned Qwen 3 models that might want to switc
5.
The Bitter Lesson(finbarr.ca)
2 points by fnbr 1y ago|0 comments
6.
by fnbr 1y ago
Like what? All the examples people have said are where either 1) the company has Nx preferences, for N >1, in which case the company has essentially failed to fundraise or 2) the company sells for less than they raised, which again, is a
7.
by fnbr 1y ago
This is why I will never work somewhere with a short post termination exercise period (PTEP). If it’s not at least 5 years, ideally 10, they don’t seriously consider equity something that employees are owed.
8.
by fnbr 1y ago
Can you explain? In most cases, preferences won’t come into play, assuming you raise at a standard 1x preference and sell for more than you have raised. In that case, owning 0.5% should roughly translate into $5M (modulo dilution).
9.
How to hire ML engineers/researchers(artfintel.com)
1 points by fnbr 2y ago|0 comments
10.
by fnbr 2y ago
I hate how every company that I place an order with treats that as permission to send a constant drip of marketing emails. I send them straight to spam.
11.
by fnbr 2y ago
They raised ~$200M total, and $150M at the series A. So if they're just paying back investors, they'd "only" need $500M.
12.
by fnbr 2y ago
do we know they were profitable? I doubt it, if they pulled this. I think they had high DAU/MAU but low paid users. this is basically Inflection 2.0.
13.
by fnbr 2y ago
Yes, many AI startups pay more than FAANG for ML talent.
14.
by fnbr 2y ago
What's the dating app?
15.
by fnbr 2y ago
The rule of thumb is roughly 44gb, as most models are trained in bf16, and require 16 bits per parameter, so 2 bytes. You need a bit more for activations, so maybe 50GB? you need enough RAM and HBM (GPU RAM) so it’s a constraint on both.
16.
OpenAI departures: Why can’t former employees talk?(vox.com)
1254 points by fnbr 2y ago|961 comments
17.
by fnbr 2y ago
Agreed, that’s what I’m seeing too.
18.
by fnbr 2y ago
These prices are insane- you can do much, much better than those prices if you negotiate. If you're paying $7.20 per GPU-hour for an H100, you should find another supplier.
19.
by fnbr 2y ago
Yeah Alberta has very little hydro, while Ontario/Quebec/BC have lots, so our electricity generates a lot more carbon.
20.
by fnbr 2y ago
That's a great reason not to have electric rental cars, but not a great reason to not charge rental cars.
21.
by fnbr 2y ago
I meant rent on GCP. You’re right.
22.
by fnbr 2y ago
I’m surprised they sell any to external customers, to be honest.
23.
by fnbr 2y ago
Wow. This is surprising. Not even an acquihire. I’m very curious about what happened internally to lead to this.
24.
by fnbr 3y ago
Private equity firms. I’d never take money from them.
25.
by fnbr 3y ago
No, unfortunately. But my gas/electricity is fixed price, so it doesn’t matter. I’m sure this will be coming as heat pumps get more common. It’s a pretty easy calculation to do.
26.
by fnbr 3y ago
Yup, me too. And with my Nest thermostat, I can manually configure the crossover point. I did so at the economic balance point (where the heat pump is cheaper than my gas furnace).
27.
by fnbr 3y ago
1) i actually think that’s too high, i bet it’s more like 30%. My logic is that they have to have _some_ margin, but LLMs are too expensive to have typical software margins. Total speculation though. 2) It generally tracks pretty well unles
28.
by fnbr 3y ago
It’s not clear to me what’s happening on the distillation front. I agree no one is doing it externally, but I suspect that the foundation model companies are doing it internally, performance is just too good. There’s a bunch of recent work
29.
by fnbr 3y ago
Ha! I got a ton of new subscribers this morning and was wondering why. Let me know if I can answer any questions (I am the author).
30.
by fnbr 3y ago
Assuming your numbers are correct, they sold for 50x ARR, which is a very very good price. I bet that’s why. It’s hard to do better than that.

More ›