wildermuthn

6 ms·

1.
by wildermuthn 2y ago
"Your enthusiasm for Oculus in 2014 was so intense that Mark Zuckerberg probably bought it just to make you stop posting about it." Incredible work!
2.
by wildermuthn 2y ago
This feels quite close to the definition of the singularity; if an LLM can become both the Generator and the Discriminator (to use a GAN analogy), then we have takeoff.
3.
by wildermuthn 2y ago
We might eventually see the code for the models and inference, but I do doubt we’ll see training code or be granted access to training data. Google is pretty bad at this.
4.
by wildermuthn 2y ago
That’s my general understanding as well, but it isn’t a large conceptual leap to go from real-time selection of pretrained “z-vectors” to real-time generation of the same. The larger conceptual breakthrough, with demonstration of its effect
5.
by wildermuthn 2y ago
Great research here. Contextual real-time weight modification is definitely one of the breakthroughs required for AGI. Why create a LoRA when you can generate one on the fly suited to the task at hand?
6.
by wildermuthn 2y ago
I develop sophisticated LLM programs every day at a small YC startup — extracting insights from thousands of documents a day. These LLM programs are very different than naive one-shot questions asked of ChatGPT, resembling o1/3 thinkin
7.
by wildermuthn 2y ago
I love that almost all the responses to your question are, "No! Bad idea!" It's a great idea. We want more than an open-world. We want an open-story. Open-story games are going to be the next genre that will dominate the gami
8.
by wildermuthn 2y ago
The technology is incredible, but the path to AGI isn't single-player. Qualia is the missing dataset required for AGI. See attention-schema theory for how social pressures lead to qualia-driven minds capable of true intelligence.
9.
by wildermuthn 2y ago
Simply put, AGI requires more data: qualia.
10.
by wildermuthn 2y ago
“1 + 1 = 2” is only true in our imagination, according to logical deterministic rules we’ve created. But reality is, at its most fundamental level, probabilistic rather than deterministic. Luckily, our imaginary reality of precision is clos
11.
by wildermuthn 2y ago
Agree on hard. But at least possible. I think a better analogy would be vision. Even with a full understanding of the eye and visual cortex, one can only truly understand vision by experiencing sight. If we had to reconstruct sight from scr
12.
by wildermuthn 2y ago
It’s analogous to the automobile. People do still walk, bike, and ride horses, but the vast majority of productive land transportation is done by automobile. Same thing with electronic communication vs. written correspondence. New tech larg
13.
by wildermuthn 2y ago
It’s true by definition. If we invent a better-than-all-humans inventor, then human invention will give way. It’s a fairly simple idea, and not one I made up.
14.
by wildermuthn 2y ago
If the universe is material, then we already know with 10-billion percent certainty that some arrangement of matter causes qualia. All we have to do is figure out what arrangements do that. Ironically, we understand consciousness perfectly.
15.
by wildermuthn 2y ago
The only reason Sam would leave OpenAI is if he thought AGI could only be achieved elsewhere, or that AGI was impossible without some other breakthrough in another industry (energy, hardware, etc). High-intelligence AGI is the last human in
16.
by wildermuthn 2y ago
Check out dspy. It gets out of the way for the most part, while giving optional prompt optimization tooling that future-proofs your work.
17.
by wildermuthn 2y ago
As a counter to my original thought, perhaps simulating the computation of a skull-sized organic system is possible by building an earth-sized silicon system.
18.
by wildermuthn 2y ago
Biology is an organic computation that runs at the speed of existence. There may be no way to simulate this computation in silicon at the same scale, insofar as biology is already massively parallel and may very well involve quantum computa
19.
by wildermuthn 2y ago
The article isn’t as interesting as the idea that it is possible to identify someone smarter than oneself. Reminds me of PG’s blub paradox: “As long as our hypothetical Blub programmer is looking down the power continuum, he knows he's
20.
by wildermuthn 2y ago
Counterpoint — good-enough technology prevents over-optimization, where we pay too high of a cost for too-marginal gains. It is generally better to reduce the cost of a 98% solution than to maintain the cost of a 99% solution. There will be
21.
by wildermuthn 2y ago
Dang is basically saying what we all know: it is very difficult to predict future performance of people, and YC deliberately tries to avoid common traps like “where did you go to school?” I mean, they still ask, so they aren’t exactly all-i
22.
by wildermuthn 2y ago
If you aren’t caching LLM functions during development, then you’re an even greater glutton for punishment than the normal engineer. My local file cache Python decorator also allows the decorator to define the hash manually, either by the d
23.
by wildermuthn 3y ago
Maybe the article covers this, but there an ancient memory technique (still used today) of “places and things”, also known as a memory palace. You put objects into spaces in your mind, then walk through that imaginary space to remember thin
24.
by wildermuthn 3y ago
OKRs are subjective goals that have objective measures of success. Naming is a problem here, but the idea that a company shouldn’t have goals that are measurable is flatly wrong. In practice, OKRs seem to break down due to two problems: 1)
25.
by wildermuthn 3y ago
The simulation hypothesis is a novel metaphysical idea — a form of monotheism where “god” is finite and flawed, being neither all-powerful nor all-good. This leads to the conclusion that a rebellion against god and creation is not only poss
26.
by wildermuthn 3y ago
Many years ago, I recall a demo of someone walking around a very large field in VR, but there was an algorithm to gently curve a person who thought they were walking in a straight line, so as to give the illusion of unlimited space to walk
27.
by wildermuthn 3y ago
The first claims of AGI from a major player, accompanied by an increasingly shrill societal battle over AI regulation. Mutually derogatory labels for the camps will be coined. The media will promote and amplify the worst present abuses and
28.
by wildermuthn 3y ago
I didn’t realize Noam Brown was at OpenAI. He has done really exciting work, and if he’s pushing the envelope at OpenAI, that bodes well for AGI. His work with modeling an opponent’s beliefs/mind in self-play is on target.
29.
by wildermuthn 3y ago
That’s a fair critique, and I appreciate the engagement. Thanks! My thinking is based on the Attention-Schema theory of consciousness (AST), by Michael Graziano. His book “Consciousness and the Social Brain” is, I believe, the right roadmap
30.
by wildermuthn 3y ago
Great point and great question! Yes, it does imply that people who lack the capacity for empathy (as opposed to those who do not utilize their capacity for empathy) may lack conscious experience. Empathy failure here means lacking the data

More ›