azakai

11 ms·

1.
by azakai 5d ago
Judging by the slow speed of node here, I wonder if it was run without forcing optimizations. It doesn't do OSR (on-stack replacement), meaning that a benchmark script doesn't get a chance to tier up from the baseline compiler to
2.
by azakai 6d ago
ChessNetwork on YouTube also does a great job with this: analysis of interesting games, using Stockfish as a tool along the way.
3.
by azakai 12d ago
TFA says > Type confusion in V8 in Google Chrome prior to 152.0.7977.82 allowed a remote attacker to execute arbitrary code inside the sandbox via a crafted HTML page. So it was fixed in 152.0.7977.82 (before .83), if I read that right.
4.
by azakai 13d ago
That their marketing department must love this does not prove it was intentional.
5.
by azakai 15d ago
Those are fair points.
6.
by azakai 15d ago
We don't know all the details about how the brain computes, you are right. But we do have a hypothesis: that it is done by a large number of simple units with very high connectivity and in deep layers. This is what neural networks mode
7.
by azakai 15d ago
But neurotransmitters and action potentials don't help in modeling symbolic structure. That is, yes, ANNs are not brains. There are countless differences. But are there differences at the computational level? ANNs are meant to model br
8.
by azakai 24d ago
> LLMs can detect patterns at a scale that no human ever could, but patterns only get you so far. This is asserted without evidence, and from a scientific standpoint, unjustified. First, "detect patterns" makes it sound like a
9.
by azakai 2mo ago
If you want a more concrete example, then LLMs are also trained on visual data these days, which means they do have access to the world in an important way. This directly contradicts the blogpost's claim that LLMs have > no way to a
10.
by azakai 2mo ago
You can also take the opposite conclusion from this: C++ is now viable because LLMs can catch the security bugs. I'm obviously not entirely serious here, but I think this is true to some extent: the number of memory safety bugs in a co
11.
by azakai 2mo ago
> How much of the identity of a mathematician is tied up in being the first to discovery? Here is how I'd put it: math has an enormous focus on discovery. It is why we have Godel's incompleteness theorems, the Cantor set, Zor
12.
by azakai 2mo ago
Wait, what does this mean? > We reuse WebAssembly linear memories under the covers to implement and sandbox the GC heap. A reference to a GC object is not a native pointer, it is a 32-bit index into the GC heap’s underlying linear memory
13.
by azakai 2mo ago
The overall point feels strained to me. Yes, formal mathematics has such limits. We can't expect machines to be perfect and provably perfect. But the industry isn't assuming that. Why would it? Natural intelligence is not perfect
14.
by azakai 2mo ago
> All of the AI projects we have observed as a team are failing. Every single one – we have seen 0% success in a year and a half, What is an "AI project"? The post doesn't define it. Is it writing some software from scratc
15.
by azakai 2mo ago
I'm not sure what "branch on undefined values" means there, yeah, but never reusing memory addresses is enough to prevent use-after-free. Or, rather, you can use a value after freeing it, but it will not be exploitable, becau
16.
by azakai 2mo ago
Zig does offer some amount of temporal memory safety. Link: https://zig.guide/standard-library/allocators/ Text: > The Zig standard library also has a general-purpose debug allocator. This is a safe allocator t
17.
by azakai 2mo ago
Prior art: WebKit.js, the WebKit rendering engine ported to JS https://github.com/trevorlinton/webkit.js/
18.
by azakai 2mo ago
The researchers in the field disagree with you. Look at conferences like NeurIPS and ICLR to see a steady stream of incremental progress in this area.
19.
by azakai 2mo ago
The optimism is based on the successes so far, some of which are described in this article. Scientists have made progress here.
20.
by azakai 2mo ago
Yes, we do see signs of actual reasoning, see the papers linked in the article. (There are many others too.) Yes, we have a tendency to anthropomorphize, but (most) researchers are aware of this.
21.
by azakai 2mo ago
The article answers this question, at least to the extent it can be answered, at this time. We see some signs of reasoning, but also we understand little about how they work.
22.
by azakai 2mo ago
They made a claim about language models in general, not just ones that had been released so far. The point of the paper, in fact, is that language models are getting "too big", and another approach is needed to make progress, so t
23.
by azakai 2mo ago
My main criticism of the paper is that it says LLMs work "haphazardly", using probabilistic information. That is a hypothesis, but it is stated as a known fact, a fundamental limitation. It is true that LLMs often behave haphazard
24.
by azakai 3mo ago
Yes. Godot and Zig are the exceptions, and therefore newsworthy.
25.
We Don't Understand Neural Networks at the Algorithmic Level(kripken.github.io)
2 points by azakai 3mo ago|0 comments
26.
by azakai 3mo ago
> Let's keep WebAssembly lean and fast! Note that wasm is still lean and fast - WASI is not part of core wasm, but layered on top. That is, it is possible to implement wasm without WASI. That is also true for other wasm proposals li
27.
by azakai 3mo ago
Not the person you are responding to, but here: > I believe that artificial intelligence has three quarters to prove itself before the apocalypse comes, and when it does, it will be that much worse, savaging the revenues of the biggest c
28.
by azakai 3mo ago
Exactly. Here is where this happens in the paper: > Suppose one copies an LLM into AoE II and feeds into the AoE II-LLM ‘I feel lonely’ as an input. This AoE II-LLM replies: ‘I feel bad for you, maybe catch up with a friend? Closeness al
29.
by azakai 4mo ago
What about the cognitive capacity of understanding?
30.
by azakai 4mo ago
If you want examples of this, see the recent book "The AI Con" https://www.goodreads.com/en/book/show/217432753-the-ai-con which describes LLMs as "souped-up autocomplete", complex statist

More ›