dippogriff

7 ms·

1.
by dippogriff 3mo ago
I want to see more text-free foundation models
2.
by dippogriff 3mo ago
If the labs weren't so aggressive with building datacenters in people's backyards, this could've been a different story. People don't like it when pipelines are built in their backyard either.
3.
by dippogriff 3mo ago
They tried that a few times and the mistakes have had consequences.
4.
by dippogriff 3mo ago
This is excellent! Very useful takeaways. Being able to properly do continuous training in production is key with robotics data being so hard to come by.
5.
by dippogriff 3mo ago
Great work showing on how brittle these GUI benchmarks can be! Love the visuals. I wonder if SFT is the problem here as opposed to the coordinate discretization; what happens with continuous action space?
6.
by dippogriff 3mo ago
This is cool. Creative ways to do external verification is the only path to solving training on LLM slop
7.
by dippogriff 3mo ago
Neat! minor nit - would be nice if the esc button took you back to the list, instead of having the click the X button
8.
by dippogriff 3mo ago
The current way benchmarks are done and are accepted by the community makes for really uninspired work. Until we're willing to break out of this rigid evaluation format prone to crazy overfitting and gaming, talent will move elsewhere.
9.
by dippogriff 3mo ago
Edge models will get much better after the current insane capex and organic data for pre-training is dried out. But hard to see how the best open source models will ever come close to the best closed ones.
10.
by dippogriff 3mo ago
Vice versa, the exaggeration of vitamin D is mildly worthless. Some need supplements, some don't.
11.
by dippogriff 3mo ago
I'm a fan of this direction. For me the most interesting use case for these world models isn't even training, it's verification. If this thing or some idealized version of it can actually reliably simulate state transitions,