jboss10

7 ms·

1.
by jboss10 14d ago
This model is on the pareto frontier, by Artificial Analysis' benchmarks. https://artificialanalysis.ai/?cost=intelligence-vs-cost-per...
2.
by jboss10 19d ago
Sad this isn't about keyboards.
3.
by jboss10 1mo ago
From here, it looks like opencode is hemorrhaging money. I've got a Opencode Zen free account, and I've been using deepseek-v4-flash-free on Pi for a bit, and I haven't hit a limit yet. Sometimes my request fails, but retrys
4.
by jboss10 2mo ago
> Gemini 4 helped with the editing. Does this guy have access to Gemini 4 already? I'm guessing Gemma 4 was happy to be mistaken for Gemini and didn't catch this mistake.
5.
by jboss10 2mo ago
How does it run the LLMs? Or does it call a API to llama.cpp/ollama/etc. ? During normal usage, how often does it try to parse info from the screen capture? Once a minute?
6.
by jboss10 2mo ago
Michael Stevens (of Vsause fame) copies long quotes into notebooks, and he claims the act of writing it helps him remember. And if it's not worth writing, it's not a good enough quote.
7.
by jboss10 2mo ago
Some of these are quite nice(I like gemma 3.5 flash's work) https://s3.eu-west-1.amazonaws.com/images.dylancastillo.co/p... https://s3.eu-west-1.amazonaws.com/images.dylancastillo.co/p...
8.
by jboss10 2mo ago
They supposedly have a style control system, but I doubt it's perfect. I wish there was a parento view like this for agentic systems(using a standard harness)
9.
by jboss10 2mo ago
I use this setup as well. I've written an alias for bwrap which only gives the agent access to the current directory and read only access to the docs. It has read-only access to my binaries, and I worry which programs I have might be a
10.
by jboss10 2mo ago
I think this is one of the easiest to understand. https://arena.ai/leaderboard/text/pareto
11.
by jboss10 2mo ago
The second point is funny. I don't think not using air conditioning due to energy use is why Europeans don't have AC. (I'm European). It's beacuse it's expensive and difficult to retrofit. And we are getting more AC
12.
by jboss10 2mo ago
This does read a little like AI, but I can't see many vocabulary based Claude-isms. But it does start with an anecdote, and there are other aspects of the writing which seem AI.
13.
by jboss10 2mo ago
I think the "architectural features" are part of the model, not the kv cache. So implementing it would be difficult and expensive.
14.
by jboss10 2mo ago
Most of the time, the speed of these models are constrained by memory bandwidth. GPUs normally have much more memory bandwidth.
15.
by jboss10 2mo ago
> Gondolin gives you that. Lightweight micro-VMs (QEMU by default, optional libkrun backend) boot in under a second on your Mac or Linux machine. The network stack and virtual filesystem are implemented entirely in JavaScript, giving you
16.
by jboss10 2mo ago
I don't think there is any content. When you try and view the page, it seems to send: 301 Moved Permanently Location: https://www.youtube.com/watch?v=nj6caVbtM_g&t=2s
17.
by jboss10 2mo ago
It would be beneficial to not use youtube links for things like QR codes. Since the content of youtube videos can't be changed once they're posted, you risk linking to old information. https://cew.georgetown.edu/ab
18.
by jboss10 2mo ago
Gondolin[1] is what you are describing. It's made by the same person who made the Pi coding agent and sends all of the agent's bash into a small QEMU vm. [1]( https://earendil-works.github.io/gondolin/
19.
by jboss10 2mo ago
I think most of this can be done with tmux and some simple extras. An afternoon of vibing.
20.
by jboss10 2mo ago
For people who saw this and might want a recomendation, I like running a tiny qwen model with llama cpp. Qwen2.5 coder 0.5B or 1.5B (not the instruct version) On a modern-ish GPU these should run really fast with little latency. They cost n
21.
by jboss10 2mo ago
The plugin is just part of why OsmAnd is good for nautical use, there is also an alternate view in the configure map menu for nautical use.
22.
by jboss10 3mo ago
Look into deepseek's papers. They have done some stuff recently about improving inference and it seems to be how they can sell tokens so cheap.
23.
by jboss10 3mo ago
I'm running llama-swap in a docker container with nvidia container utis to pass through the GPU. This then runs the correct llama-server command to provide the model I want. I have a folder full of guff s I mount in the container. But
24.
by jboss10 3mo ago
I should try gemma4 more for coding, since qwen3.6 and gemma4 came out I've focused on qwen. For earlier releases I found qwen was smarter, but gemma had more knowledge. But for coding I always want it to learn how to do the task, not
25.
by jboss10 3mo ago
Qwen 3.6 35B runs on 32GB with a 1080. That GPU is from 2017.
26.
by jboss10 3mo ago
I have 8GB VRAM but 32GB RAM. Qwen 3.6 35B runs nicely. You should look at gemma-4-26B-A4B. 16+8=24gb and Q4 is about 16GB. Not much context left, but might run.
27.
by jboss10 3mo ago
I have 8GB VRAM, but 32GB sys ram. I can run qwen 3.6 35B at 30 tok/s. I also use pi, and it's smart enough to extend itself(multishot and maybe a few tries) For you, you could try gemma-4-26B-A4B
28.
by jboss10 3mo ago
I don't understand the talk about how expensive the hardware is. These models can run on very old or old and low end. I've been running Qwen3.6-35B Q4 on an old 1080 GPU(8GB vram) with 32GB sys RAM. I have a i7-12700. It does abou
29.
by jboss10 3mo ago
They can be ran on 32GB with 8GB VRAM. I don't think these will be on 16GB for a while. (35B MoE)
30.
by jboss10 3mo ago
For the 35B model, ofloading to RAM doesn't slow it down much. If you have a nice CPU and a weak GPU, it will be fast enough to use.

More ›