upbeat_general

7 ms·

1.
by upbeat_general 2mo ago
This is just not how it works - it is perfectly plausible (in fact the most likely) that pretraining was well finished by the time Fable was released. A bit of extra distillation takes far less compute. Moreover, it’s very plausible (and ex
2.
by upbeat_general 3mo ago
Same way you do for planes, cars, etc. You have long(ish) life-cycles and some pieces that can be independent (e.g., same turbine engine on several plane models).
3.
by upbeat_general 3mo ago
If I used a racecar to go 25mph in a residential neighborhood, I’d make a similar conclusion.
4.
by upbeat_general 3mo ago
I think that figure (haven’t verified it but assuming it’s true) isn’t complete. It hides who and where those people are - for example, I imagine art history skews towards higher ranked schools in the first place.
5.
by upbeat_general 3mo ago
If we’re defining on-prem as fitting in a rack - then every frontier model can be hosted on-prem. Now this might not be the most cost effective (and may require a bit extra power), but you only need a datacenter for training or cost optimiz
6.
by upbeat_general 4mo ago
This statement is well known to be incorrect for at least a year.
7.
by upbeat_general 4mo ago
If by "happened to" you mean pour significant resources for well-over a decade on many different AI research groups then yes, that's accurate. Depending on your definition of AI, it might even be two decades. In fact, OpenAI
8.
by upbeat_general 5mo ago
This isn’t quite accurate. Data weighting is quite important in pretraining.
9.
by upbeat_general 5mo ago
Sampling exists.
10.
by upbeat_general 8mo ago
From a user perspective it is nice to know that the person decoding will likely support a given format, both now and in the future. More use cases for a single popular format makes this more likely.
11.
by upbeat_general 9mo ago
I really wish that there was an “almost yolo” mode that was permissive but with light restrictions (eg no rm), or even better, a light supervisor model to prevent very dangerous commands but allow everything else.
12.
by upbeat_general 10mo ago
I can assure you that lacking knowledge in DPO (and especially GRPO it’s just stripped down PPO) is not a dealbreaker.
13.
by upbeat_general 1y ago
This seems like the perfect case for legislation that starts out targeting higher volume devices/larger companies and lower over time. I don’t see why the industry couldn’t move to providing this documentation/full source over a f
14.
by upbeat_general 1y ago
Not saying it’s for sure the case but it might be that the model gets confused by OOD text from the other model whereas it expects its own text to be online from itself (particularly if the CoT is used as context for later conversations).
15.
by upbeat_general 1y ago
A lot of developers (including myself) don’t want to notarize/sign their binaries that they want to run on their own machine(s).
16.
by upbeat_general 2y ago
And it was none of the mentioned schools!
17.
by upbeat_general 2y ago
Seconding another commenter. I went to a state-school (maybe in the top 5 US state schools) and got an offer without any elite background.
18.
by upbeat_general 2y ago
Related: I've been pretty frustrated with cursor that you can't call any APIs directly, and it all has to go through their backend. Along with this, they have essentially refused to fix bugs in their custom API key page for months
19.
by upbeat_general 2y ago
Here’s the simple reason why this is not the case: If you provide the 6DoF trajectory (+ gripper joints), a lot of robotics (manipulation in particular) is basically solved. The problem is, we don’t have these good trajectories. Sure, joint
20.
by upbeat_general 2y ago
Not a war crime, China has plenty of agriculture. See the Cuban missile crisis. It is an act of war but certainly not as escalatory as direct attack.
21.
by upbeat_general 2y ago
The challenge here is not IK. Sure, you don’t need IK if your policy directly operates in joint space but this isn’t the motivation for doing RL. IK to my knowledge is well known in every setting I am aware of.
22.
by upbeat_general 2y ago
Has anyone used Typst for academic conferences/journals? To me it’s sorta like CSS where the availability of templates is more important than the core language (at least for people lacking design abilities).
23.
by upbeat_general 2y ago
It’s less reproducible than docker (assuming the pip usage is correct). Docker specifies a lot of OS properties that UV ignores. That being said, UV is great.
24.
by upbeat_general 2y ago
I tried out uv a bit ago and dropped it. But about two weeks ago, I switched to it and migrated two projects with no issues. Things like pypi sources per dep are there finally. I still find rough points (as many others pointed out, especial
25.
by upbeat_general 2y ago
imo gemini-exp-1206 is the best public LLM that exists right now.
26.
by upbeat_general 2y ago
Clusters and supercomputers are able to fully control the hardware & OS. environment modules are useful in that setting but do not solve OS differences, not to mention themselves need to be installed/maintained. lots of time develo
27.
by upbeat_general 2y ago
For a start, any suite that takes >X hours on a single node, especially compounded if you have a large team of developers. > At least as long as you're running your own code on your own hardware Assuming you keep a consistent env
28.
by upbeat_general 2y ago
I think it’s just super handy to know where you’ve been. Great to be able to find places (“Oh I loved this Thai place I went to 4 years ago in X city”) Also to be able to find photos in specific locations (if you integrate it with geotagged
29.
by upbeat_general 2y ago
Oh this looks cool, will give it a try!
30.
by upbeat_general 2y ago
For the longest time I’ve wanted a way to record my location history in a durable way, without resorting to google maps history (which is great but has…obvious downsides), or some hacky short-term custom solution. I wonder if someone could

More ›