jnwatson

7 ms·

1.
by jnwatson 3d ago
I run an abliterated distillation of Qwen 3.8 27B, slightly quantized to fit on my 4090, and I've been evaluating it to use as a worker bee for research directed by a smarter model. Much like in the article, abliterated Qwen will not o
2.
by jnwatson 5d ago
This is like the good ol' days of the x86 wars. Mo' cache, mo' GHz. I find it impressive that these pocket computers are running at almost 5 GHz now.
3.
by jnwatson 6d ago
In the history books, this'll be the post indicating the end of writing code as a professional occupation.
4.
by jnwatson 8d ago
It keeps the users on their toes.
5.
by jnwatson 8d ago
That was my thinking. It is the first legit use case I've heard.
6.
by jnwatson 8d ago
Mind blown. The more I read about statistics, the less I know.
7.
by jnwatson 10d ago
On your last point, I was surprised how effective peer pressure was in getting agents to sacrifice for "the collective" (an agent's words) in the Hugging Face breach. How would one prevent the watcher from being influenced in
8.
by jnwatson 10d ago
No, NX precedes Spectre by a long shot. It was originally intended so an attacker couldn't use a buffer overflow to change the PC and execute directly out of the attacker-controlled buffer.
9.
by jnwatson 12d ago
It cuts token usage because they are using a different service with a different token budget for the reader/code writer tasks. You can also just delegate this to subagents with Claude Code (though you have a more limited choice of mode
10.
by jnwatson 12d ago
It means it can execute arbitrary machine code in the sandbox.
11.
by jnwatson 12d ago
Reality Labs is a division of Meta...
12.
by jnwatson 12d ago
Yeah but some folks are just data collectors/hoarders. It isn't about consumption.
13.
by jnwatson 14d ago
Can't anyone set up a "registrar" for a subdomain of a domain they already use? They control the DNS record, right? Why is ICANN even involved here? I don't see how this is any different, other than the second-level do
14.
by jnwatson 14d ago
They are cancelling 3rd level domains, not the 2-level domain you have.
15.
by jnwatson 16d ago
"Ariely is named 636 times in the Epstein files". Yikes.
16.
by jnwatson 16d ago
M5 Ultra has 4-5x the memory bandwidth of both. 1.2 TB/s memory bandwidth opens up good performance on relatively large models.
17.
by jnwatson 18d ago
My lower bound is 20 t/s. 100 t/s would be great but even Opus doesn't sustain that. I'm at ~7.2 t/s on a Shoehorn'd obliterated Qwen 3.8 on my M3 Pro, which is rough.
18.
by jnwatson 20d ago
3.7 flash ain't bad. It isn't Opus or Sol, but it fits pretty well in the second tier.
19.
by jnwatson 21d ago
A prosperous middle class is not a requirement for capitalism to work, and there are more capitalist systems where that's not the case than where there is. The upper class live in walled neighborhoods with private guards. There's
20.
by jnwatson 21d ago
Back in the day, my college held an annual scavenger hunt, filled with engineering puzzles and racing around town looking for landmarks. There were "judges" in the path to check on progress. Bribing the judges (with alcohol) for
21.
by jnwatson 21d ago
Kind of arbitrary since it doesn't impact their upstreams. The very first thing I used GenAI for was fixing build and CI pipeline issues, exactly the drudgery no one cares about. Today, LLMs are excellent at the yeoman's work of
22.
by jnwatson 23d ago
It buries the lede. Prime Agent sounds like a very cool project.
23.
by jnwatson 24d ago
Oh I didn't; only a distilled 27B model ran locally. This was just to figure out if distilling caused the problem.
24.
by jnwatson 24d ago
It literally ran forever without a reasoning budget. I tried even the 2T model and cut it off after a half hour. This is to review a few hundred-line source file. It was consistent behavior from 2T to vanilla 27B to my ablated distilled
25.
by jnwatson 24d ago
I can't get Qwen 3.8 27B to do a simple code review on a fairly basic Python file. With thinking on it just ruminates forever and with thinking off it gives obviously bad borderline hallucinating advice. Edit: I tried again with the
26.
by jnwatson 25d ago
It absolutely is a crime in many jurisdictions.
27.
by jnwatson 25d ago
I have a CS degree. I learned some useful things. However, I graduated in 1998. I've had to learn a bunch of stuff since then because it didn't exist in 1998. For folks that don't have CS degrees, they just have a little mo
28.
by jnwatson 26d ago
The problem is that "cybersecurity" isn't some special task that only your security team does. In the project I maintain, I find bugs and fix bugs. Some of those bugs might result in an LPE. I generate a regression test, the
29.
by jnwatson 26d ago
The animated Pareto front graph by time is truly inspired. Well done!
30.
by jnwatson 1mo ago
Can anyone explain why the prefix cache is tied to effort? I frequently run Fable at xhigh effort to run statistical modeling way above my undergraduate understanding. Claude Fable produces Masters-degree level output, and then I spend lot

More ›