defmacr0

6 ms·

1.
by defmacr0 6d ago
This can easily lead you down a path of excessive modularity with each module being excessively complex though
2.
by defmacr0 6d ago
They're almost certainly pin-pointing high-quality conversations and giving them a special weighting. Seems stupid to not do that.
3.
by defmacr0 7d ago
Yeah and we get a nice list of attributions for who developed which idea, while OpenAI just takes credit for everything its model spits out.
4.
by defmacr0 7d ago
A lot of math is extremely specialized, to the extent that only a handful of other experts in some field have any experience with those mathematical ideas, with most of them not even yet present in the published literature. It's really
5.
by defmacr0 9d ago
Also, if we just take "high-quality" input data, which these chats would certainly be classified as, then the models are more than large enough to memorize everything verbatim. Spitballing some numbers, research literature suggest
6.
by defmacr0 9d ago
If there's one thing I'm absolutely confident in, it's that Sam Altman personally goes to great lengths ensuring that ethical standards are upheld at his company.
7.
by defmacr0 9d ago
> So why wasn't Anthropic behind their effort? Presumably because this was something Levent did in his spare time and because it was not obvious that this work would eventually lead to a breakthrough. > Why did Tristan use OpenAI
8.
by defmacr0 9d ago
As a prior I would say that a math professor has about infinite times more integrity than OpenAI.
9.
by defmacr0 9d ago
I am stunned anyone is giving OpenAI the benefit of the doubt
10.
by defmacr0 1mo ago
There's a spectrum between "barely scientific entertainment" and "dry technical reference". Also, it's not fully a zero-sum tradeoff, great authors have written serious textbooks that are quite entertaining to
11.
by defmacr0 1mo ago
I certainly would only trust my textbook as the authoritative source, but i can see that in the absence of an expert teacher it's nice to have something that can critique a proof. Imo the fact that it's hard to verify that your ow
12.
by defmacr0 2mo ago
Yeah, clean, neatly seperated and logically independent PRs are very nice for reviewers, but usually it requires one to complete the whole feature and then go back and think about the best way to seperate it into a series of smaller changes
13.
by defmacr0 2mo ago
I take credit given all my infosec-related reddit posts they used for training.
14.
by defmacr0 2mo ago
Well at least it seems pretty implausible to me that a machine learning model trained to reproduce human text can in principle generate something that is significantly above human text production ability. If the "pea-sized semiconducto
15.
by defmacr0 2mo ago
The article is "not even wrong". Most of the argument just circles around an inconsistent definition of what "real world" means. > Remember "imaginary numbers" from algebra? You could do funky stuff with the
16.
by defmacr0 3mo ago
> Any solution that can convince the Germans, the most privacy obsessed sticklers on the whole planet, has my support by proxy. If they think it's safe enough, it most likely is. Almost no other country has seen the dark side of wha
17.
by defmacr0 3mo ago
> Real life is not anonymous and consequence free either, why should online life be? In real life you are largely anonymous if you go to any place that is not in your social circle. If I go to any physical store under the sun and pay in
18.
by defmacr0 3mo ago
> even when they'd benefit from blabbing. Ok but what conspiracy theories are even filtered out by this? Whistleblowers almost always do it at great personal cost.
19.
by defmacr0 3mo ago
Formally politicians may be in charge, but at this point most political power derives from within the administrative state.
20.
by defmacr0 4mo ago
People, especially underage, commit suicide over private information of theirs getting leaked.
21.
by defmacr0 5mo ago
Also 95% of those 30k lines changed are fully self-contained inside of the aarch64 directory and of the remaining changes it looks like the majority is just adding "aarch64" as another item into an existing list. There are a few c
22.
by defmacr0 5mo ago
I don't understand that methodology in the first place. Does Anthropic even have some kind of somewhat objective definition to measure and judge "memorization"? Is there any evidence that other LLMs are viable tool to determi
23.
by defmacr0 5mo ago
If we were perfectly rational, then yeah, more data should never lead to worse decisions. However, it's easy to fall into the trap where being data-driven makes you only work on those things that you know how to measure.
24.
by defmacr0 5mo ago
That's worse than a report that can be easily dismissed
25.
by defmacr0 5mo ago
https://www.cs.columbia.edu/~angelos/Papers/hydan.pdf Here's some more prior art
26.
by defmacr0 5mo ago
In x86, a basic immediate instruction with a 1 Byte immediate value is encoded like this: <op> (1 Byte opcode), <Registers> (1 Byte), <immediate value> (1 Byte) While xor eax, eax only uses 2 bytes. Since there are only 8
27.
by defmacr0 5mo ago
I would be surprised if modern CPUs didn't decode "xor eax, eax" into a set of micro-ops that simply moves from an externally invisible dedicated 0 register. These days the x86 ISA is more of an API contract than an actual re
28.
by defmacr0 5mo ago
We have not been shown any evidence that shows anything approaching this scale of people dead, we have not been told on what basis that specific number of deaths was determined and we have not been told why that supposed evidence can not be
29.
by defmacr0 5mo ago
> This also re-opens a lot of "party pooper" results in mathematics: impossibility of representing solutions to general quintic (fine print: if we restrict ourselves to arithmetic and roots/radicals). Solving the quintic i
30.
by defmacr0 5mo ago
It's very common when people start doing a new exercise regimen. Muscles can become significantly stronger on a timescale of months, while an equivalent increase in the strength of tendons happens on a timescale of a few years. Once so

More ›