FinchNova12

16 ms·

1.
by FinchNova12 2mo ago
I agree that if you have the weights you can use/train a model with the same architecture, and that you won't get the exact weights on your own due to randomness. But isn't data an extremely important part of your ability to
2.
by FinchNova12 2mo ago
I thought there is discussion circulating around whether the main reason Kimi is impressive is due to distillation. Though possibly if this occurred, this was just one component of their training pipeline and not a majority
3.
by FinchNova12 2mo ago
"Kimi is largely a byproduct of distillation" and "Kimi is introducing new and novel approaches" are not mutually exclusive, and I'm not sure it's clear from the paper how much of the improvement comes from the
4.
by FinchNova12 2mo ago
Hmm, why do you think this is true? One reason I'm skeptical of this is because RL envs are often purchased (and are not publicly available), and this might be a sizable component of why models are getting better.
5.
by FinchNova12 1y ago
They state that they are heavily uncertain: > We remain highly uncertain about the potential moral status of Claude and other LLMs, now or in the future. However, we take the issue seriously, and alongside our research program we’re work
6.
by FinchNova12 2y ago
> Our adversaries are great at espionage, stealing models that fit on a thumb drive is relatively easy, and most tech companies are far from operating in a way that would make this more difficult. Mostly unrelated to the correctness of t
7.
by FinchNova12 2y ago
Not sure if you intended this, but it feels like the first sentence of your argument is more broadly a critique of the credentials of AI Safety proponents. Maybe you are distinguishing between doomers vs broader AI Safety proponents, but if
8.
by FinchNova12 2y ago
Previous discussion: https://news.ycombinator.com/item?id=28520221
9.
by FinchNova12 2y ago
Okay this is reasonable, thanks for clarifying
10.
by FinchNova12 2y ago
What? How is this not saying "Well, it might be in the best interests of humanity for OpenAI to do [hypothetical thing that seems pretty bad that OpenAI has never suggested to do], and because they may consider doing said thing, we sho
11.
by FinchNova12 3y ago
No, you can blame EAs for making stupid decisions and being generally bad people if they are making stupid decisions and being generally bad people. I'll second that I'm sorry for the bad experiences you've had with EAs. In m
12.
by FinchNova12 3y ago
While I agree that the rhetoric around AI Safety would be better if it tried to address some of the benefits (and not embody the full doomer vibe), I don't think many of the 'core thinkers' are unaware of the benefits in AGI.