gw32

5 ms·

1.
by gw32 6d ago
Altman miscalculated badly. OpenAI took what could have been amazing publicity, and in a rush to publish, gave reason for users to distrust their core product. It's like they're allergic to slowing down.
2.
by gw32 8d ago
https://mathstodon.xyz/@tao/117207849921390904 Tao agrees.
3.
by gw32 28d ago
I have found satisfaction in thinking about activation multidimensionally (free energy surfaces). It lends the interpretation of reactants trying to escape gravity well-like local minima, crossing marginally more unstable transition states*
4.
by gw32 28d ago
I'm glad to find someone who shares this perspective. Sigmoids show up everywhere (e.g. elo). One big area is AI ability. Coding agents have gone from completely unreliable to quite reliable at basic tasks. Maybe this could be true abo
5.
by gw32 1mo ago
> The VARIANT type shipped in DuckDB v1.5, and the way to think about it is JSON on steroids. Basically, imagine if JSON were fast. [...] DuckDB automatically detects the common structure hidden in your semi-structured data and “shreds”
6.
by gw32 1mo ago
Interesting work. I'm surprised that hypothesis 2 (that CSV serialization format mangles table columns) was falsified. Back in the gpt-3.5-turbo and gpt-4o era, I did needle-haystack tests and found that table format mattered a lot (cs
7.
by gw32 1mo ago
Am I the only one who enjoys taking notes? But more in the sense of recording knowledge so that I have it in perpetuity. For instance, I have almost completely forgotten how to solve ODEs, even though I had a good command of it when I learn
8.
by gw32 1mo ago
> Big no for retyping llm generated code by hand. There must be some merit to retyping LLM generated code, even verbatim. In school, I would rewrite or re-typeset notes as a study habit. In doing so, I'd review content, detect err
9.
by gw32 4mo ago
Well elucidated. This problem has irked me for years in the form of multiple inheritance. When it's disallowed (like Java, unfortunately), trying to reduce a directed graph structure to a single dominant hierarchy is quite the botherso
10.
by gw32 4mo ago
"beyond comprehension" is a good way of putting it. I've been genuinely baffled by some of these AI designs - why any intelligent thing would write >10 lines of bloat for what should be a one-liner.
11.
by gw32 4mo ago
Ironic: my value as a programmer now comes not from my ability to write code, but my ability to delete the useless fluff that AI wrote.
12.
by gw32 4mo ago
Neat puzzle, juggling between local and long-range effects. It's surprising how often the bishop gets in the way.
13.
by gw32 4mo ago
I was wondering that too. One would think that with a greedy approach, 1 square diagonally from the corner would be better. (But that doesn't work as well.)