canjobear

7 ms·

1.
by canjobear 5d ago
> Mao came quite close to abolishing Chinese characters entirely during the Cultural Revolution This was indeed the Communists’ original plan, but the real story is more interesting. Before taking over the country the plan was to replace
2.
by canjobear 7d ago
A refutation of that view: https://www.complexsystemspodcast.com/episodes/credit-card-r...
3.
by canjobear 8d ago
What was his reputation before OpenAI?
4.
by canjobear 10d ago
The point of TFA is that there are regularities you can exploit in the actually existing weights of machine learning systems, not in some hypothetically maximally efficient weights. The maximally efficient weights would indeed have no struc
5.
by canjobear 10d ago
The weights aren’t compressed. So there are interpretable redundancies in practice.
6.
by canjobear 10d ago
It was accepted to NeurIPS.
7.
by canjobear 11d ago
I’ve encountered several people now who consult LLMs constantly for nearly every decision. Some proportion of people will absolutely cede their thinking to these things, and some already have.
8.
by canjobear 11d ago
> What about cooking food? We've become entirely dependent on cooking food. In evolutionary time, we lost the ability to digest raw meat because we offloaded so much of process of the digestion to the cultural technology of cooking.
9.
by canjobear 11d ago
It is a collaboration across many institutions including those from Europe, the US, and Japan
10.
LLMs as a Cognitive Virus(arxiv.org)
394 points by canjobear 11d ago|256 comments
11.
by canjobear 14d ago
His arguments apply generally to a large family of interpretability methods. Skimming suffices to figure out that the linked article is in that family.
12.
by canjobear 1mo ago
Compression is still prediction, the predictions just might not be good.
13.
by canjobear 1mo ago
His videos on the people this article is about https://youtu.be/9cwcN-mm4xs https://youtu.be/XcDmr2_fvNo
14.
by canjobear 2mo ago
What are some example questions you would pose that are against American political values?
15.
by canjobear 3mo ago
It was standard procedure to do invasive surgeries on newborns without anesthesia until the 1980s, on the theory that they can’t feel pain. https://hms.harvard.edu/news/long-life-early-pain
16.
by canjobear 3mo ago
Midwives don’t participate in C-sections
17.
by canjobear 3mo ago
I was clicking around in response to this article and found this video that explains the inspection paradox nicely. https://youtu.be/Jd1wNizPjoE
18.
by canjobear 3mo ago
You can evaluate the logic for the decipherment step by step and make sure all the claims are justified. But the best test is to try the proposed decipherment against some new text and see if it makes sense. In the case of Linear A and the
19.
by canjobear 3mo ago
> Tom's work is credible enough that it's being reviewed by linguistics experts at Rutgers and Cambridge What does this mean? Like he e-mailed it to some people at Rutgers and Cambridge? Or it's under some kind of non-anon
20.
by canjobear 3mo ago
Gratuitous destruction of books by librarians has been done for a while. See https://en.wikipedia.org/wiki/Double_Fold
21.
by canjobear 3mo ago
Egyptian writing had phonetic elements (as does the modern Chinese writing system) but it was not an alphabet in the strict linguistic sense that individual symbols indicated individual phonemes.
22.
by canjobear 3mo ago
Close. One approach is to conjecture that the universe only supports a limited about of information per unit surface area. https://en.wikipedia.org/wiki/Entropic_gravity
23.
by canjobear 3mo ago
Also very well explained by PBS Spacetime here https://youtu.be/UKxQTvqcpSg
24.
by canjobear 3mo ago
It’s not typeset in math mode so you can’t expect the hyphen to correspond to minus.
25.
by canjobear 4mo ago
A mapping of Chinese characters to integers (like a tokenizer) would not be a dictionary. You’d also need definitions. At best it’s an index to a hypothetical dictionary.
26.
by canjobear 4mo ago
Your model of what AI is good at is wrong. Generative AI is not good at wandering off into novel esoteric abstract corners while maintaining correctness, it is good at things that are close to its training data. I suspect that humans will l
27.
by canjobear 4mo ago
I have multiple friends now who used to quote me that factoid, then went to Florida and came back convinced that no, Florida man is real.
28.
by canjobear 4mo ago
Google search already had a huge quality slide before 2022.
29.
by canjobear 4mo ago
As early as last year "AI psychosis" seemed to refer to people going crazy due to talking to ChatGPT too much. That was a useful term for a real phenomenon! Now it seems like it's been taken over to mean "thinking that A
30.
by canjobear 4mo ago
PhD students paying tuition would be highly unusual.

More ›