_alternator_

4 ms·

1.
by _alternator_ 8d ago
I'll give you the benefit of the doubt. GP was referring to the use of copyrighted material to train LLMs.
2.
by _alternator_ 8d ago
I think "close to completion" is not the right framing. Creating good open problems was an achievement because these problems often sit at the edge of known techniques, and solutions require inventing "new math". It&#x2
3.
by _alternator_ 8d ago
I mean, the oracle doesn't really seem so hypothetical right now. And clearly it's going to drastically change these fields, and mathematics, particularly pure mathematics, must change most of all in order to adapt to the existanc
4.
by _alternator_ 8d ago
Yes, and they will. But what's happening here is that the system that cultivates mathematics (and mathematicians) is recieving likely the biggest shock of its history. How do you reward merit and identify talen when people can't a
5.
by _alternator_ 8d ago
This series of posts by Terry Tao is a direct response to the Navier-Stokes results (multiple results!) from the last 24 hours. The question is what is left after the levelling of mathematics, in all its senses, occurs? How can you protect
6.
Tao: Open math problems being non-renewably mined by AI(mathstodon.xyz)
491 points by _alternator_ 8d ago|420 comments
7.
by _alternator_ 8d ago
> The significance of this with respect to the way we train students, assign credit, referee, and decide what is worth one human life’s attention cannot be understated. This. What is worth a human life's attention? As little as a mo
8.
Is mathematics about to enter the conservatory?(mbmccoy.dev)
134 points by _alternator_ 10d ago|141 comments
9.
by _alternator_ 10d ago
The argument is that chain-of-thought without "tokens" would remove a major interpretability and model intent control pane. This is definitely borne out in the OpenAI's report on the huggingface attack; they had turned of CoT
10.
by _alternator_ 11d ago
The claim seems speculative, but grounded. For example, as part of the hugging face attack, the agents began signing messages because they were worried about impersonation on a publicly accessible message board. It's only a small step
11.
by _alternator_ 21d ago
Tell me more about this!
12.
by _alternator_ 24d ago
I think you point out something really important: there real value isn't the data, it's in surfacing the useful data. For amateur astronomers, an interesting question is whether there is a satellite above me that I can see tonight
13.
by _alternator_ 24d ago
Seems to have taken several open-source pieces of data (live satellite feeds, NASA UAP files) and combined them into a vaguely conspiracy-ish website. It's really odd, but has the feel of old-timey conspiracy websites spruced up with v
14.
by _alternator_ 29d ago
Are you saying that "entropy" = "worse" and that somehow these human stories of earlier golden ages reflect a law of physics? Seems much more likely that they, like this article, reflect the ingrained human psychological
15.
by _alternator_ 1mo ago
Depends on your definition of what "real" means. Does it mean that people really have the experience of seeing little people? If so, then in that sense it's real. Or does it mean that these little people exist in some other w
16.
by _alternator_ 1mo ago
Accurate weather forecasting has been one of the major achievements of the 20th and 21st century. Computing power is a central piece of this story, but it's also important to remember that the government infrastructure in place to coll
17.
by _alternator_ 2mo ago
Clench the other fist while writing. This loosens the writing hand. Something in the subconscious releases tension in the other hand. It's a trick I've used with reasonable success and it's immediately effective. It does requ
18.
by _alternator_ 2mo ago
What I think is really going on is an attempt to segment the market in favor of Google's strengths. It's a bet that models are "good enough" for many use cases even before they reach human-level intelligence, and Google
19.
by _alternator_ 2mo ago
I've heard of capture technologies that literally pump organic matter down far enough that it sinks to the seabed (high enough pressure collapses air bubbles and results negative buoyancy). The problem is that your pumps need to operat
20.
by _alternator_ 2mo ago
It seems that we have two different stories here: in one, the new optimization theory represents a stark departure from the prior art, a sort of revolutionary new view of the understanding of optimization as applied to neural networks. In t
21.
by _alternator_ 2mo ago
Yes, apologies, I didn't read the articles you linked before posting this. I did update the comment. I don't think this changes the point, which is that most optimization methods used in AI owe a substantial intellectual debt to c
22.
by _alternator_ 2mo ago
I'm sorry this comment didn't sit well with you. My goal was to induce discussion by describing the claimed result (which was buried in the post), not to discourage it. If you have more specific feedback on what you found distaste
23.
by _alternator_ 2mo ago
I'll point out that "does not work" is not the same as "not as efficient" :) But it does seem the Adam paper had an error. I think that Nesterov's first order method is the most efficient general first order al
24.
by _alternator_ 2mo ago
I'd push back on this. Most of the core optimization techniques (eg, ADAM, stochastic gradient descent) are straight out of the convex optimization literature. Generally you need to use optimizers that work well on convex objectives be
25.
by _alternator_ 2mo ago
I know a bit about this field. This conjecture reads as somewhat more niche than the cyclic double cover conjecture recently proved by OpenAI, but nevertheless represents a real contribution. You want to know how long it takes to solve an o
26.
by _alternator_ 2mo ago
An example that came up in the article is medicine (or more precisely a medical patent), which also clearly has an extremely strong time value, particularly for lifesaving medicine.
27.
by _alternator_ 2mo ago
My read was that MC = "market clearing price" not "marginal cost". Being a bit more humble, perhaps the lesson is that the difference between the theory and reality highlights externalities that always exist in the real
28.
by _alternator_ 2mo ago
The tails could be heavy, it's true. This could make my usual 1-in-1000 heuristic overly conservative. Let's go with that, heavy tails. The data shows we are at something between a 1-in40 and 1-in-20 deviation. Normally (pun inten
29.
by _alternator_ 2mo ago
Fair, I had to click into the full size (I pinch zoomed on my phone). But now the fact that 1988/1989 are outliers raise a few more questions about the variance calculation. In particular, the title suggests that those weren't inc
30.
by _alternator_ 2mo ago
With a headline like that the graph should be at the beginning. Usually you'd put it up front and then talk about the graph, not put it at the bottom and talk about how people aren't talking about it. Anyway, I scrolled down to th

More ›