mmastrac

5 ms·

1.
by mmastrac 4d ago
magnet:?xt=urn:btih:67177297E84766DFBF1C9EAAC6CF44B6F40BF3D1 I haven't checked it out myself but I've heard that some posts were removed from this magnet.
2.
by mmastrac 4d ago
This is one of the best references on this topic I've seen - run cycles and foot locking are annoyingly lacking in documentation outside a few papers.
3.
by mmastrac 6d ago
I'm using DSH with my local models (4x sparks running GLM53F, trying them on DS41F this morning). DSH is better than opencode IMO. It's a little barebones out of the box but I guess that's the point. I had to have an agent ad
4.
Rust is tier-1 language at Microsoft(rustfoundation.org)
726 points by mmastrac 6d ago|518 comments
5.
by mmastrac 6d ago
I ran the preview model around 2,126,605,070 tokens for $22.04 USD for the last couple of days. Kind of shocked. It did a decent job refactoring https://github.com/mmastrac/diffgemma to create a CUDA support backbone,
6.
by mmastrac 7d ago
I've been trying out the 4.1 flash preview for some bulk tasks: it did a pretty good job refactoring a bunch of .metal kernels to .cu. It needed less steering than Opus on refactoring, IMO, and writes better comments. It failed to port
7.
by mmastrac 8d ago
https://github.com/mmastrac/diffgemma#custom-quantization has some instructions on (naively) quantizing the upstream model as well.
8.
by mmastrac 8d ago
It should be possible to run on Mac via https://github.com/mmastrac/diffgemma , but I'm at rustconf right now and I can't download weights on hotel wifi easily.
9.
by mmastrac 12d ago
Honestly, not sure. I use Firefox Mobile pretty heavily during the day and I suspect it's part of the drain. I'm not too concerned by it and I just try to replace the battery every ~1-1.5 years.
10.
by mmastrac 12d ago
I've been running mine for ~4ish I think, on my third battery and might run out my fourth because it's feeling a _little_ sluggish at times. I am waiting for the next FP model where I can use a USB-C/dp external display and t
11.
by mmastrac 13d ago
The comparisons with other models here are odd.. the other models change depending on the task. It would be far more useful to at least compare against the more recent open models (DS4Flash/GLM53Flash/Qwen38).
12.
by mmastrac 14d ago
Any idea what size this is?
13.
by mmastrac 16d ago
Do you have a source for more info? That seems odd to me - LLMs are particularly resilient to bitflips, so if anything the demand would pull on DDR5 in general, not on ECC specifically.
14.
by mmastrac 16d ago
What's missing from these discussions is the real weakness of diffusion models: you can have two positions where two tokens need to be coordinated, but both spots are teetering between two valid states. They don't always collapse
15.
by mmastrac 16d ago
Is there a lookup that gives you a title to blob mapping?
16.
by mmastrac 17d ago
Oh nice. I have a little PCIe/VGA one that I use for truenas and it's a bit flaky but I love that it's basically free from a PCIe perspective (just toss it off _any_ root). These are super useful and there are even m.2 varian
17.
by mmastrac 19d ago
If you can explain how to make compaction not suck in opencode or Kilo Code, I would love to know how. I am really trying to make use of other harnesses but that's a major sticking point.
18.
by mmastrac 19d ago
Yes, sorry 5.3 flash.
19.
by mmastrac 19d ago
NVFP4 ~20-30tps (MTP + vision, no dflash2).
20.
by mmastrac 19d ago
I previously posted that DS4Flash was _good_ but not _great_ on two DGX Sparks, but I have to say that GLM-5.3 is pretty amazing. It's been able to tackle all the random hard problems I've thrown at it and it has the intuition tha
21.
by mmastrac 21d ago
Sparks + cables + 10g SFP+ came out to ~$21,500 CAD
22.
by mmastrac 21d ago
I think I need one now that I have four - reduce is ring-oriented and still works I believe, but IIRC you only get 200gbps if you use _one_ of two connectx ports.
23.
by mmastrac 21d ago
What harness? I've had similar results as _Implicated_ said above - it's not done well in any of the tests I've tried with it. I currently have it hung off DS4Flash as a pseudo-vision tool and subagent only because of this.
24.
by mmastrac 21d ago
The cables are ~USD $50 from AliExpress although I'm not sure what the tariff situation is for Americans (I think I paid $75 all-in CAD for them)
25.
by mmastrac 21d ago
I already have a recycled QNAP-now-TrueNAS that has 10G connections into the fleet so the 1TB doesn't bother me at all. I did some rough math and I don't think I'll ever need to load weights off NFS for what I'm doing so
26.
by mmastrac 21d ago
For me it's entirely because I have a bunch of projects with my own personal data that would be tough to do with openrouter/claude or any other cloud. For example, I have a small posix-shell-based LLM harness that can SSH into my
27.
by mmastrac 21d ago
I bought 4x Asus GX10 with the 1TB option. I don't understand why, but it's the only model in the whole lineup that isn't priced insanely. They were briefly on sale with a $200-off coupon, but they show up on warehouse deals
28.
by mmastrac 21d ago
Weights on HF here: https://huggingface.co/zai-org/GLM-5.3-Flash I decided to take the plunge and get myself four sparks at a decent price (and bought the QSFP cables from AliExpress because they are literally 1/2
29.
by mmastrac 23d ago
I'm currently on sabbatical looking for volunteer work. I always thought IPFS was an interesting project, might be happy to pitch in some of my now-free bandwidth.
30.
by mmastrac 24d ago
rsync tends to be a bit tougher on smaller CPUs. scp is generally better for those cases if you don't mind hashing afterwards to confirm everything made it without bit flips (in theory it shouldn't happen, but I've definitely

More ›