magusdei

9 ms·

1.
by magusdei 4y ago
There's plenty of retrieval-based models that do cite sources. They just didn't want to deal with it for this release.[1] I'm sure it's already on the roadmap. [1] In fact, some snooping suggests they specifically disabl
2.
by magusdei 4y ago
No, it would take approximately 3 minutes where you either write a paragraph in the desired style yourself or paste one from the Internet and then ask it to continue in that style. Even if you decided to go the more onerous fine-tuning rout
3.
by magusdei 4y ago
"Ego sophos, ergo et qui mihi similiter cogitant sophi sunt"?
4.
by magusdei 4y ago
>AI anime character generator game startups that YC seems to enjoy investing in Wait, YC invests in this space? If it isn't any trouble, could you point me to a few?
5.
by magusdei 4y ago
>If you have details, let me know. Athanasius is greek for "immortal" and is a common name of saints, church fathers etc. Lubensk (Лубенськ) is an obscure city near Luhansk. Saint Athanasius of Lubensk refers to Athanasius III
6.
by magusdei 5y ago
According to myth, Tamamo-no-Mae would attach herself to emperors and drive them mad, causing them to commit massacres. Hmm...
7.
by magusdei 5y ago
Your feelings are understandable, but I'd say you will be more effective in actually helping people if you manage to develop compassion even towards people who seem hate-worthy. I wish you continued success in your practice.
8.
by magusdei 5y ago
Then, would you say your actions are in line with the compassionate awareness of bodhicitta?
9.
by magusdei 5y ago
"Monks, do not wage wordy warfare, saying: 'You don't understand this Dhamma and discipline, I understand this Dhamma and discipline'; 'How could you understand it? You have fallen into wrong practices: I have the r
10.
by magusdei 5y ago
Sorry that my answer comes so late, but I'll put this here for posterity. I will only address the latter part. My point was that a brain is an N x N -matrix in the same sense as an ANN. An ANN is no more an N x N -matrix "in rea
11.
by magusdei 5y ago
It depends on what you'd consider fundamental. It's true that most of our advances since the mid-80s have been about improving the robustness, data- and compute-efficiency of the training process through optimized architectures an
12.
by magusdei 5y ago
There's a good reason for this -- the version of GPT-3 used for these tests was fine-tuned on CYOA adventures, where this kind of sudden death is very common.
13.
by magusdei 5y ago
Your commitment to empiricism is admirable. What kind of evidence would you find sufficient?
14.
by magusdei 5y ago
If you know what a Markov chain is then you must also know that modern language models are nothing like Markov chains. Just as an example, a Markov chain can't do causal reasoning or correctly solve unseen programming puzzles, the way
15.
by magusdei 5y ago
Ending up "net ahead" does not necessarily mean maximizing the fraction of successful projects. I don't think pg is saying that implausible-sounding projects usually turn out good. He is saying that when they turn out good,
16.
by magusdei 6y ago
Wouldn't the empirical success of GPT-3 in simple programming tasks itself be evidence against this interpretation? Furthermore, GPT-3 is only a language model because it is trained on textual data. Transformer architectures simply map
17.
by magusdei 6y ago
You can play in a similar way with code. It's just that other developers will hate you for it.
18.
by magusdei 6y ago
Context-free grammars were originally invented by linguists for analyzing natural language. You can see examples of phrase structure and dependency diagrams e.g. here: https://en.wikipedia.org/wiki/Dependency_grammar F
19.
by magusdei 6y ago
I don't think so. Uncurated GPT-3 output is generally very noticeable because it is unable to hold coherence for an article of this length, and will often make the same points over and over in slight variations and sometimes even contr
20.
by magusdei 6y ago
Hmm, this still doesn't quite answer my question at the level of concreteness I was looking for. But thank you for clarifying. The thing is, you can only define predictive accuracy relative to some experimental design. Otherwise you ca
21.
by magusdei 6y ago
Can you specify what you mean by "emulate my brain within an acceptable margin of error"? What would this mean as an actual experiment? Depending on your answer, I think we can actually test your implicit proposition that no such
22.
by magusdei 6y ago
I've actually done this experiment by putting a GPT-3 bot in a Telegram group. Its replies were mostly stuck in an uncanny valley where they sort of made sense, but often either lacked detail or seemed to very slightly misunderstand wh
23.
Why GPT-3 can understand things(magusdei.com)
1 points by magusdei 6y ago|0 comments
24.
by magusdei 6y ago
You are of course free to model the underlying causality as you see fit, but the fact remains that this is one of the most robust and well-understood findings in all of psychology (see e.g. the Rescorla-Wagner model). The effect does not de
25.
by magusdei 6y ago
I suppose. But given the constant inflation in what we demand of AI for it to count as "intelligent", it seems that eventually our tests will become so strict that most humans will not be able to pass them.
26.
by magusdei 6y ago
I doubt it. Mitsuku, a purely rule-based chatbot, was already able to correctly answer almost all questions of this form in 2014 simply by querying a large knowledge base of common-sense facts.[1] On the neural net side, Google's seq2s
27.
by magusdei 6y ago
Yeesh, gwern. Usually I enjoy your comments, but this one seems a bit unfair. Of course if you want to know the long-term future of robotics, you should look to sci-fi authors and research prototypes. But if you want to know the short-term
28.
by magusdei 7y ago
Isomorphism != equality. Formulas in greek numerals are trivially isomorphic to ones using arabic numerals, because they are different representations of the "same" concepts, but nobody would argue that arabic numerals aren't