greens

6 ms·

1.
by greens 5y ago
https://en.wikipedia.org/wiki/Cutoff_(physics)
2.
by greens 5y ago
355 laptop years seems very low for training GPT-3
3.
by greens 5y ago
It's a paradox of the "look I proved AGI is impossible" papers.
4.
by greens 5y ago
A single consumer GPU for ~hours
5.
by greens 5y ago
This is a common misconception. GPT-3 was trained using a 300B token (~300gb) subset of common-crawl and friends. The model is larger than the dataset.
6.
by greens 5y ago
That's a great point. You could argue despite the huge number of physical degrees of freedom, the operations on DNA can be reduced to copy, repair, express, suppress. On the other hand, there's still a ton of intrinsic complexity
7.
by greens 5y ago
My 2c (apologies for the aggressive tone -- I'm just excited about AGI): That's a very very weak upper bound on how much hardware it takes. I think it's not all that different from emulating a Nintendo64 with a quantum simula
8.
by greens 6y ago
Ok, sorry for assuming bad faith and ranting. Still, I think it's pretty hard to compare engineering achievements like this. Is it harder to make a fission bomb in 6 years with 1940s technology, or a COVID vaccine in 1 year with 2020s
9.
by greens 6y ago
I can't believe that you're talking about the mass-murder of civilians like it's some sort of triumph, especially since you could have made the exact same point citing the trinity test. And it's so weird that you use the
10.
by greens 6y ago
∫0->∞ x*e^-tx dx = -∂_t ∫0->∞ e^-tx dx = -∂_t (1/t)∫0->∞ e^-u du = -∂_t (1/t) = 1/t^2
11.
by greens 6y ago
L^1's derivative is a perfectly good function, it's not defined or continuous at 0, but whatever... it's for the same reason that the median handles even-sized sets in a special way. 0 = d/ds \sum_i | x_i - s | = \sum_i
12.
by greens 7y ago
For gravity and EM fields the inverse square law is a consequence of a massless force carrier particle and Lorentz invariance. Quantum Field Theory in a Nutshell by Zee talks about this early on.