celrod

7 ms·

1.
by celrod 5d ago
I was just trying deepseek v4.1 flash on OpenRouter. After running reasonably well for a while, I return to the window and see that my scrollback is nothing but this repeated over and over again: ``` OK. Let me write. Let me go. OK. Let me
2.
by celrod 8d ago
If Q4 takes less than 1.3x as many tokens as bf16 or q8, it could still end up being faster, given how decode tends to be bandwidth bound. The kv cache was still bf16, so a few ops are the same between quants.
3.
by celrod 13d ago
Mercor, Tacit Labs, Handshake AI... I suspect companies like these play a big part in model improvements, generating high quality benchmark/task-focused data for training. However, these do require educated, white collar, workers.
4.
by celrod 15d ago
> A narrow set of frontier LLM development tasks, such as distributed training infrastructure, ML accelerator design, and kernel development for certain non-standard chips. https://support.claude.com/en/articles&#x2F
5.
by celrod 15d ago
I'm a kernel engineer. Fable 5 refused all my requests, falling back to Opus 4.8. My wife is a chemist. Her experience wasn't much better.
6.
by celrod 1mo ago
I think I'd rather have the model stop once the obvious solutions failed and ask me. It can suggest more creative ideas, but I don't necessarily want it to try implementing them.
7.
by celrod 2mo ago
A few years ago, on July 4th one of my mom's dogs freaked out, somehow managed to escape, and got hit by a car before my mom found her. She loved that dog, regularly attending nose work competitions with it. One of your pets getting a
8.
by celrod 3mo ago
When claude goes down a wrong path, I tend to clear context and write a new prompt that helps guide it down the correct path. Whatever thinking or context that led it there has inertia and tends to be sticky, otherwise. Pretty annoying when
9.
by celrod 3mo ago
I found this, which has some: https://arxiv.org/pdf/2605.28876 TLDR: RTK does not look good according to the author's benchmark.
10.
by celrod 3mo ago
That list also places Sonnet 4.6 above Opus 4.6, which doesn't match my experience.
11.
by celrod 3mo ago
Exactly. How can "we" develop and encourage benchmarks for multi-turn user assistance? That is what I want. I feel like the models and harnesses push much too hard against this workflow -- that they push you towards letting go an
12.
by celrod 3mo ago
What quant do you run it at? 32GB seems like cutting it close on the rtx 5090 if going 8b, but other commenters are saying 4b lobotomizes the model.
13.
by celrod 3mo ago
If performance is the concern, ugrep will get you most of the way there relative to gnu grep, and should be fully grep compatible in terms of syntax: https://github.com/Genivia/ugrep#aliases Claude Code may ship with u
14.
by celrod 4mo ago
Yes. I think one of the big advantages of SoA is that you only pay for the fields you're currently using. If you need a field somewhere, you can add it and only pay the cost of iterating it where you need it.
15.
by celrod 4mo ago
foot also offers a client/server architecture. If you start a foot server (e.g. with a systemd service), you can use `footclient -N`. This may reduce the memory pressure of running many terminals. This is similar to the `kitty --single
16.
by celrod 4mo ago
Yeah, for now. I'd like it to be open, but I also want to potentially be able to make money/a living off of it. My dream would be that it can be open while hardware vendors pay me to optimize for their hardware. For how, being c
17.
by celrod 4mo ago
I'm still working on it. I'm currently working on a cache tile-size optimization algorithm that should (a) handle trees (a set of loops can be merged at some cache levels and split at others, e.g. in an MLP it may carry an output
18.
by celrod 4mo ago
I was once a bit of a Julia performance expert, but moved toward c++ for hobby projects even while still using Julia professionally. I wrote a blog post at the time with exactly that punchline (not explicitly stated, but just look at the co
19.
by celrod 5mo ago
Fellow kakoune user here. I'm curious about your use case/ what you're doing with it!
20.
by celrod 6mo ago
In my experience, llms don't reason well about expected states, contracts, invariants, etc. Partly because that don't have long term memory and are often forced to reason about code in isolation. Maybe this means all invariants sh
21.
by celrod 8mo ago
I netted huge performance wins out of AVX512 on my Skylake-X chips all the time. I'm excited about less downclocking and smarter throttling algorithms, but AVX512 was great even without them -- mostly just hampered by poor hardware av
22.
by celrod 10mo ago
They're 8x A720 + 4x M520, not Snapdragon X.
23.
by celrod 10mo ago
I use niri and footclient -N, so builtin window and tab completion don't appeal to be. Foot feels fast, but I've not actually measured the latency. It also seems to use less CPU than GPU accelerated terminals (which it isn't)
24.
by celrod 11mo ago
I use kakoune, and don't understand why helix seems to be taking off while kakoune (which predated and inspired helix) remains niche. Kakoune fully embraces the unix philosophy, even going so far as relying on OS (or terminal-multiplex
25.
by celrod 11mo ago
I think they're arguing Cause -> cognitive disease Cause -> plaques That is, that the same cause is behind both. There may be some arrows from plaque to disease as well (i.e., that plaques also increase disease). I dont know the
26.
by celrod 1y ago
Is including batteries the main reason helix seems to have started taking off, while kakoune hasn't? I use kakoune, because I like the client/server architecture for managing multiple windows, which helix can't do. The less c
27.
by celrod 1y ago
I agree. The problem with eager diagnostics and templates is that the program could define a `Base<int>` specialization that has a working copy constructor later. [0] I think if you define an explicit instantiation definition, it shou
28.
by celrod 2y ago
I use Wshadow personally. I highly recommend it. I think code that violates it (even if correct) is harder to understand.
29.
by celrod 2y ago
> I don't want my web browser or video player to be resized because I open a new program I've been using niri (a tiling WM) recently. This is their very first design principle: https://github.com/YaLTeR/nir
30.
by celrod 2y ago
Do you not often quickly look between files? If so, odds are you're using tiles within tmux, vim, emacs, vscode, or something. I use kakoune, which has a client/server architecture. Each kak instance I open within a project connec

More ›