dunb

9 ms·

1.
by dunb 5mo ago
Why use --fit on on an M4? My understanding was that given the unified memory, you should push all layers to the GPU with --n-gpu-layers all. Setting --flash-attn on and --no-mmap may also get you better results.
2.
by dunb 5mo ago
3.6 is the release version for Qwen. This model is a mixture of experts (MoE), so while the total model size is big (35 billion parameters), each forward pass only activates a portion of the network that’s most relevant to your request (3 b
3.
by dunb 6mo ago
What is it lacking in your eyes that makes it not true? I find fish’s vi mode more ergonomically complete for things like editing multi-line commands
4.
by dunb 6mo ago
Are you running with all the --fit options and it’s not working correctly? You could try looking at how many layers are being attempted to offload and manually adjust from there. Walk down --n-gpu-layers with a bash script until it loads.
5.
Codex 5.3 (Xhigh) Solved a 6 Month Old Bug in Ghostty(twitter.com)
4 points by dunb 7mo ago|0 comments
6.
by dunb 8mo ago
I'm not sure if it's working right for me on Orion Version 1.0.3 (142), WebKit 624.1.2.19.2. I type my word, hit "Enter," and I still get the hint to press "Enter." It would also probably be more effective to n
7.
by dunb 10mo ago
Others have already told you the name of the project, but if you happen to be on Arch, I have a PKGBUILD written for PlantStudio. I haven't published it to the AUR since I don't necessarily want to be the maintainer though. Shoot
8.
by dunb 11mo ago
This isn't rsync, but you can integrate a-Shell[0] with iOS Shortcuts. You would need to make the syncing happen in the script instead of in the background though. I use a Python script to create aliases for my email this way, so I don
9.
by dunb 11mo ago
Location: Alabama, USA Remote: Yes — hybrid and office roles okay Willing to relocate: Yes Technologies: Python, Tensorflow, PyTorch, scikit-learn, OpenCV, seaborn, MLflow, R, LaTeX, Linux, Git, Bash Résumé/CV: h
10.
by dunb 11mo ago
I follow a similar but more terse pattern. I prepend them all with a comma, and I have yet to find any collisions. If you're using bash (and I assume posix sh as well), the comma character has no special meaning, so this is quite a nic
11.
by dunb 2y ago
What's the benefit of the container over installing as a tool with uv? It seems like extra work to get it up and running with a GPU, and if you're using a Mac, the container slows down your models.
12.
by dunb 2y ago
Is this a real bug? I recently got a MacOS device for the first time, and I have been frustrated that I couldn't get my custom service to work. Just like you, the script writes to files when I run it myself, but does nothing as a servi