EigenLord

7 ms·

1.
by EigenLord 11mo ago
I've always felt that you can't think in anything besides thought. Words, images, symbols, etc, are all side-effects. They absolutely bend back and influence the thought process, but they are always secondary and indirect. Thought
2.
by EigenLord 11mo ago
Interesting work but this strikes me as a somewhat quixotic fight against inevitable tendencies of statistical models. Reinforcement learning has a single goal, an agreeable mean. Reinforcement learning stops when the LLM produces agreeable
3.
by EigenLord 11mo ago
I think there's a critical flaw with Anthropic's approach to memory which is that they seem to hide it behind a tool call. This creates a circularity issue: the agent needs to "remember to remember." Think how screwed yo
4.
by EigenLord 11mo ago
I wish more comp sci curricula would sprinkle in more general courses in logic and especially 20th century analytic philosophy. Analytic philosophy is insanely relevant to many computer science topics especially AI.
5.
by EigenLord 1y ago
I've been thinking lately about how AGI runs up against the No Free Lunch Theorem. This is what irritates me: science is not determining the narrative. Money is. I highly recommend mathematician David Wolpert's work on the topic.
6.
by EigenLord 1y ago
Diffusion is just the logically most optimally behavior for searching massively parallel spaces without informed priors. We need to think beyond language modeling however and start to view this in terms of drug discovery etc. A good diffusi
7.
by EigenLord 1y ago
Years ago, in my writings I talked about the dangers of "oracularizing AI". From the perspective of those who don't know better, the breadth of what these models have memorized begins to approximate omniscience. They don&#x27
8.
by EigenLord 1y ago
I think the answer to the professor's dismay is quite simple. Many people are in university to survive a brutal social darwinist economic system, not to learn and cultivate their minds. Only a very small handful of them were ever there
9.
by EigenLord 1y ago
I would love it if LLMs told me I'm wrong more often and said "actually no I have a better idea." Provided, of course, that it actually follows up with a better idea.
10.
by EigenLord 1y ago
The author makes good general points but seems to be overloading MCP's responsibilities imo. My understanding of MCP is that it just provides a ready-made "doorway" for LLMs to enter and interact with externally managed resou
11.
by EigenLord 1y ago
I can see why some fields would have an overwhelmingly negative reaction to AI but I simply can't grasp why some software devs are. The entire point of the field is to get computers to do stuff for you. I've been doing this s*it f
12.
by EigenLord 2y ago
Research = revenue if you figure out the right idea.
13.
by EigenLord 2y ago
Is it really a culture divide or is it an economic incentives divide? Many AI researchers are mathematicians. Any theoretical AI research paper will typically be filled with eye-wateringly dense math. AI dissolves into math the closer you
14.
by EigenLord 2y ago
I think the author has a point. LLMs struggle with what you might call epistemically constructive novelty . It's the ability not just to synthesize existing knowledge, but to identify what's missing and conjecture something to fi
15.
by EigenLord 2y ago
You've got to do piecemeal validation steps yourself, especially for models like Sonnet 3.7 that tend to over-generate code and bury themselves in complexity. Windsurf seems to be onto something. Running Sonnet 3.7 in thinking mode wil
16.
by EigenLord 2y ago
>There is no real thinking involved. It’s just math >Implying I'll never understand this "They're just learning from past experience and making predictions!" argument, as if that doesn't constitute thinking in
17.
by EigenLord 2y ago
This post sounds like it wants to be a manifesto but really doesn't add up to much and lacks punch. Getting away from the algos is untenable if you use the mainstream internet in any capacity. The trick is to be more intentional about
18.
by EigenLord 2y ago
The role of LLMs in research is an ongoing, well, research topic of interest of mine. I think it's fine so long as a 1. a pair of human eyes has validated any of the generated outputs and 2. The "ownership rule": the human re
19.
by EigenLord 2y ago
I'm of two minds about all this. As someone who has become obsessed with seeing what these models are capable of, I can confirm that they can be used to achieve unprecedented things. But you get out what you put in. The most interestin
20.
by EigenLord 2y ago
It seems like an engineering problem to me. If you don't want ASI wreaking havoc, maybe don't hook it up to dangerous things. Silo and sandbox it, implement means to lock its access to tools/interface with the external world
21.
by EigenLord 2y ago
DR is a nice way to gather information, when it works, and then do the real research yourself from a concentrated launching point. It helps me avoid ADD braining myself into oblivion every time I search the internet. The fatal mistake is t
22.
by EigenLord 2y ago
Interesting. I've been slowly coming to the conclusion that the way forward with machine learning is actually less "machine learning" as we've grown accustomed with it, less pretraining, less data, less search, more dire
23.
by EigenLord 2y ago
This is very cool and definitely a step in the right direction, however, the question remains where exactly this formalizing module should be placed in the stack. As an external api, it's clear that the model is not "thinking&quot
24.
by EigenLord 2y ago
I see what you mean. Sometimes I intentionally divulge certain information in the hopes that I will influence the dominant LLM's outputs and thereby surreptitiously influence humanity. It's obviously a stretch but if you think abo
25.
by EigenLord 2y ago
My take: over success breeds complacency. Apple knows where its money is coming from. It has carved out an extremely hard to establish hardware production chain via iphone and macbooks, and is able to provide a certain consistent level of q
26.
by EigenLord 2y ago
I have enormous respect for Penrose and that is a very dramatic intro but I think he's venturing a little to far into philosophy for not having a specialist background. Godel himself had his quirky beliefs about the topic which Penrose