AS04

4 ms·

1.
by AS04 8d ago
No, this argument doesn't make any sense. With CoT, the model must compress hidden state to actual text and use its scratchpad as a bottlenecked representation of its past thinking. Thus, it is observable and we can tell by the pattern
2.
by AS04 7mo ago
> I really hope Framework or someone else changes that in the coming years. Building a custom CPU like Apple Silicon is plain impossible for a company like Framework. The best they can do is have support for ARM motherboards and sell tho
3.
by AS04 1y ago
Very likely to be an actual reflection. That's probably their real achievement here and the key reason why they are actually publishing it as GPT-5. More or less the best or near to it on everything while being one model, substantially
4.
by AS04 1y ago
400k context with 100% on the fiction livebench would make GPT-5 the undisputably best model IMHO. Don't think it will achieve that though, sadly.
5.
by AS04 1y ago
Don't count your chickens before they hatch. I believe that the odds of an architecture substantially better than autoregressive causal GPTs coming out of the woodwork within the next year is quite high.
6.
by AS04 1y ago
Because of the niceties of Rust, combined with the widespread compatibility and architecture support of gcc / C compilers in general? Rust is a modern language, with package management, streamlined integrated build/testing tools,
7.
by AS04 1y ago
I genuinely don't understand why some people are so critical of LLMs. This is new tech, we don't really understand the emergent effects of attention and transformers within these LLMs at all. It is very possible that, with some fu
8.
by AS04 2y ago
Unsloth also works very diligently to find and fix tokenizer issues and many other problems as soon as they can. I have comparatively little trust on ollama following up and updating everything in a timely manner. Last I checked, there is l
9.
by AS04 3y ago
My friend, what exactly do you think is so energy intensive with LK99 synthesis? I've briefly taken a look and the process proposed is really not that onerous in terms of energy consumed. It is a matter of perfecting the process that i
10.
by AS04 3y ago
Fusion would be massively boosted by having room-temperature superconductivity anyways.