Zondartul

5 ms·

1.
by Zondartul 6mo ago
It is easier to trust in the correctness and reliability of an LLM when you treat it as a glorified NLP function with a very narrow scope and limited responsibilities. That is to say, LLMs rarely mess up specific low level instructions, com
2.
by Zondartul 1y ago
In my unqualified opinion, LLMs would do better at niche languages or even specific versions of mainstream languages, as well as niche frameworks, if they were better at consultig the documentation for the language or framework, for example
3.
by Zondartul 2y ago
At some point our understanding of fundamental reality will be limited not by how much the physicists have uncovered but by how many years of university it would take to explain it. In the end each of us only has one lifetime.
4.
by Zondartul 2y ago
Comments that explain the intent, rather than implementation, are the more useful kind. And when intent doesn't match the actual code, that's a good hint - it might be why the code doesn't work.
5.
by Zondartul 2y ago
Ask stupid questions, receive stupid answers.
6.
by Zondartul 2y ago
What does "speculative" mean in this case? I understand it as CPU-level speculative execution a.k.a. branch mis-prediction, but that shouldn't have any real-world effects (or else we'd have segfaults all the time due to
7.
by Zondartul 2y ago
Normal welding needs heat to melt the metals. Cold welding happens without heat. Two metal parts will cold-weld on any smooth, touching faces if the air molecules that keep the two separated disappear.
8.
by Zondartul 2y ago
Cold welding is unintentional, spontaneous joining of two metal parts in vacuum. You don't want that to happen, especially if the parts are meant to move. Normal welding is intentional application of heat to partially melt two parts at
9.
by Zondartul 2y ago
ARC problems are too hard for me. I'm no longer sure I'm generally intelligent.
10.
by Zondartul 2y ago
By "learns" do you mean "just shove the entire codebase into the context window", or does actual training-on-my-data take place?
11.
by Zondartul 2y ago
To be fair, once someone has physical access to the machine, them having full access is just a matter of time and effort. So at that point it's security-through-too-much-effort-to-bother.
12.
by Zondartul 2y ago
Future NeuroLink collab? Grab the experience of qualia right from the brains of those who do the experiencing.
13.
by Zondartul 2y ago
If we figure out AGI, that still doesn't mean a singularity. I'm going to speak as though we're on the brink of AI outthinking every human on earth (we are not) but bear with me, I want to make it clear we're not going j
14.
by Zondartul 2y ago
You can say "Bullshit". LLMs bullshit all the time. Talk without regard to the truth or falsity of statements. It also doesn't pressupose that the trueness is known, nir deny it, so it should satisfy both camps; unlike halluc
15.
by Zondartul 2y ago
My hunch is that since LLMs are trained on a per word basis (okay, per-token), vacuus verbosity is overrepresented. If you have one normal sentence and one overly verbose, the latter will have more tokens and therefore more weight.
16.
by Zondartul 2y ago
Rule #1 of talking about the aether is "don't call it aether". Nowadays it's "spacetime this" and "mass-energy tensor that" and "properties of vacuum something else".... and we still end up
17.
by Zondartul 2y ago
I applaud the effort, but, these templated skill trees are just not very good imo. I have only one issue but it's a big one: It's missing a tree structure, so there is no ordering of skills (learn easy stuff before hard stuff beca
18.
by Zondartul 2y ago
As far as I understand, and I may be wrong here, the system is composed of two networks: Gemini and AlphaZero. Gemini, being an ordinary LLM with some fine-tunes, only does translation from natural to formal language. Then, AlphaZero solves
19.
by Zondartul 2y ago
It's cool how some minerals are just lying out in the open on Mars. On Earth this would have been washed away or buried under the soil.
20.
by Zondartul 2y ago
With how big and aggressive Disney is I'd expect it to be under ongoing litigation 24/7/365.
21.
by Zondartul 2y ago
It's convienient because any random collection letters is a "valid" brainfuck program.
22.
by Zondartul 2y ago
I'm now convinced Disney has better engineers than Tesla and SpaceX. Maybe even on par with Boston Dynamics.
23.
by Zondartul 2y ago
There is no benefit to ultra-processed fast food, but a lot of people eat it anyway. Social media is just fast food for the brain.
24.
by Zondartul 2y ago
Sorry, I meant the information that is inferred (from scratch on every token) from the entire context, and is then reduced to that single token. Every time a token is generated, the LLM looks at the entire context, does some processing (and
25.
by Zondartul 2y ago
The tokens are also necessary to store information, or at least off-load it from neuron activations. E.g. if you asked an LLM "think about X and then do Y", if the "think X" part is silent, the LLM has a high chance of:
26.
by Zondartul 3y ago
Some Moon ideas: 1) have a small robot bulldozer flatten a landing pad/polygon so there is loads of safe landing area. 2) use same dozer to make a moon highway to other sites of interest around the moon. 3) Moon GPS or laser-based l
27.
by Zondartul 3y ago
I won't say anything about the viability of the design #2 vs #3, but from purely entertainment point of view, it was fun and relaxing to watch his regular tinkering videos while he was working on the second machine, but once he stopped
28.
by Zondartul 3y ago
Quoting the article: "OTP stands for _Open Telecom Platform_, which is literally a meaningless name that was used to get the stuff open-sourced back in the old days of Erlang at Ericsson."
29.
by Zondartul 3y ago
I got reminded of an even older sci-fi story: https://qntm.org/responsibility
30.
by Zondartul 3y ago
A silly thought I had while reading that article: it presupposes that "nothing" is a noun. In doing so, it assumes that in the sentence "the <noun> <verbs>" you can substitute "nothing" and it would

More ›