c7b

6 ms·

1.
by c7b 5d ago
Even funnier that it wouldn't even be the first time that happens: https://en.wikipedia.org/wiki/Grigori_Perelman
2.
by c7b 7d ago
I remember first hearing about NMS' concept and wishing that they would take the general idea but downsize it by at least 10 orders of magnitude. A universe with 1-100 millions of planets would still feel absolutely massive and way mor
3.
by c7b 7d ago
I don't think that follows from the published results. Would have been an interesting hypothesis to add though, and quite easy. Just throw the same setup at some benchmarks.
4.
by c7b 7d ago
I wasn't aware that we have access to raw reasoning tokens? I thought what you get is a kind of summary. Does the author have some kind of privileged access or was my assumption wrong? But for the question studied here it probably does
5.
by c7b 12d ago
The article clearly distinguishes between open source and open weights models, and the headline and parts of the article state that it's open source models that are having a moment. But it doesn't list any examples. The only model
6.
by c7b 12d ago
If you're doing it for fun anyway, why not use the language that gives you the most pleasure?
7.
by c7b 20d ago
Frankly, that's the one part I would have done differently. Mixing font sizes rarely looks good, but that's just my personal opinion. If you want to visually indicate intensity, I'd have used color, or rather saturation. Not
8.
by c7b 20d ago
Congratulations! I was going to comment on the scroll field in particular when I saw this. I didn't even realize you had to hand-craft the component, but it's such a nice UI idea in general, the way the scrolling works and how the
9.
by c7b 20d ago
You must be referring to SEPA Direct Debit, which would be very risky to use to siphon funds. There's an 8 week no-questions-asked refund policy, 13 months for unauthorized transactions, if the payment fails (eg due to insufficient bal
10.
by c7b 29d ago
If you're mad at Bluesky for doing this, I think you're mad at the wrong party. Modifying intent is problematic and can be abused (although I think there's nothing particularly problematic about this particular instance). The
11.
by c7b 1mo ago
It's a noble cause, but there are probably bigger levers to pull than the model size if you care about environmental impact. If you're running Qwen3.8-27B on energy-efficient hardware like a Mac or a DGX Spark instead of an API (l
12.
by c7b 1mo ago
> I understand that to mean that they are the same architecture, just one version has a massive training set and the other has a very small subset. No. It means that the one model has 2.4 trillion parameters while the other has only 27 b
13.
by c7b 1mo ago
At a more technical level, what do you suggest? Training a small LLM on Python code exclusively? And then one on general CS/algorithms, which you'll also need? I don't think the current transformer architectures would compose
14.
by c7b 1mo ago
Sounds a bit like 'I want to make horses faster, surely I won't need mechanical engineering knowledge'. We don't know everything that we don't know, so it's hard to say what we don't need to know.
15.
by c7b 1mo ago
I've been wondering whether that is a feature of the foundation model or whatever finetuning they do on top. I remember this from the earliest versions of (pre Chat-) GPT I've been using, which would suggest it's a feature of
16.
by c7b 1mo ago
For those commenting on the long reasoning, it may be interesting to know that the reasoning effort is set to xhigh by default [0]. Other possible values are medium, low and none. Flag for changing it in llama.cpp below, but note that the l
17.
by c7b 1mo ago
The way push notifications work today is a result of said optimization. Smartphones didn't start out with constant notifications, nor did any major desktop OS have them built in the way they do today.
18.
by c7b 1mo ago
Not sure if that makes it better or worse.
19.
by c7b 1mo ago
There is some utility to ads. Knowing that my favorite shop has a promotion, that a movie, game or book I've been waiting for is out, or something other that might interest me has some usefulness. The problem isn't the ad per se,
20.
by c7b 1mo ago
Fwiw, afaik in most Oxford and Cambridge degrees the only exams that count towards your grade are in the final year or the final two years. Everything before that is basically preparation, and the colleges doing weekly supervision and regul
21.
by c7b 1mo ago
My gut feeling would be that most of not all of the points apply to Rust as well, and even more so. Rust's compiler is famously strict, the whole language and tooling is designed to catch footguns early, and it's less verbose than
22.
by c7b 1mo ago
I think the educational policies are most interesting to compare. There was systematic attrition of academic talent driven by xenophobic ideologies. It started slowly and well before the 1930's, before it turned into an all-out purge.
23.
by c7b 1mo ago
I would agree with that stance and that classical antiquity ended then. But you still have to acknowledge that the Roman state, its culture and institutions not only survived but arguably came out even more dominant (with the exception of p
24.
by c7b 1mo ago
The decline of the Roman Empire, depending on how you define it, played out over centuries, if not a millennium. It is such a bad analogy for the kind of within-our-lifetimes collapse that is being speculated about here that it undermines t
25.
by c7b 1mo ago
Seems that this is a patent application from March, so a challenge should still be possible. But it would have to come from a named entity afaik (not a lawyer).
26.
by c7b 1mo ago
But then how would you get into the news for how dangerously good your models are? And have something to warn about how dangerous open weights models could be?
27.
by c7b 1mo ago
> opting for authoritarianism before eventually the center can't hold any more and it all collapses in on itself It all depends on what you define as the collapse of the Roman Empire, but the earliest sensible candidate date would b
28.
by c7b 1mo ago
Hiring people isn't retirement, if anything it means growing your business. You're outsourcing some of the menial tasks and inherit managerial tasks instead. The show and the ROI on all those expenses still ultimately depend on hi
29.
by c7b 1mo ago
And what does taking it seriously entail?
30.
by c7b 2mo ago
I keep hearing he's retired, yet his channel looks just like any channel by a full-time influencer. The few videos of him I've watched (all quite recent) must have required substantial effort. Like, he's showing off extensive

More ›