kpw94

7 ms·

1.
by kpw94 21d ago
Remember just 6 months ago that "Ggml.ai joins Hugging Face to ensure the long-term progress of Local AI" ( https://news.ycombinator.com/item?id=47088037 ) (Ggml.ai is llama.cpp.) Curious if the “I consider HuggingF
2.
by kpw94 1mo ago
Interesting project. 2 gut feeling concerns: - Strict subset of go might be confusing to an agent actually (trying to use unavailable go features) - So -> c11 source to source compile loop might be confusing to agent: if So compiles to c
3.
by kpw94 1mo ago
Agree that go is the best due to its main design goal: A language that's simple for any programmer fitting that definition https://news.ycombinator.com/item?id=30688969 . > "They’re not capable of understanding
4.
YC: Requests for Startups – Fall 2026(ycombinator.com)
2 points by kpw94 2mo ago|0 comments
5.
by kpw94 2mo ago
> OpenAI and Anthropic, which are gearing up for potentially massive IPOs, did not sign the letter. Not anymore, OpenAI did sign it: https://www.microsoft.com/en-us/corporate-responsibility/top...
6.
Vinod Khosla to Buy Seattle Seahawks for $9.6B(sportico.com)
23 points by kpw94 2mo ago|10 comments
7.
by kpw94 2mo ago
Yeah definitely. I've recently commented on that: https://news.ycombinator.com/item?id=48557890
8.
by kpw94 2mo ago
In the context of local LLMs on limited hardware I've ran to the exact same conclusion: "tok/s" isn't the most useful metric when my personal North star metric, given my fixed hardware is: Model smart enough to exec
9.
by kpw94 3mo ago
> What it does: > > --jinja for tool calling support Pretty sure this flag hasn't done anything for a while. It's enabled by default since ~November of last year
10.
by kpw94 3mo ago
The huge spike of "lk-99" in science & frontier tech is amusing... This is cool concept, would love a positive/negative sentiment computed for each comment that refers to a given word, so you can see trends of "cloud
11.
The Mom Who Runs a Household with a Staff of AI Agents(thecut.com)
2 points by kpw94 3mo ago|0 comments
12.
by kpw94 3mo ago
Thanks! Super helpful. I do use it the same way as you're describing on personal projects at home, in a very crude manner (pasting code snippets in llama server web UI prompt. Next will attempt OpenCode) At work I use it in similar man
13.
by kpw94 3mo ago
> About the generation speed: ~100-150 t/s on the RTX 5090 and ~40 t/s on the Mac Curious if you can share the prefill speed too? I run locally on a crappy desktop (some AMD iGPU with Vulkan llama.cpp, 32 GB DDR4 RAM) for exper
14.
by kpw94 3mo ago
> gemma (unsloth/gemma-4-26B-A4B-it-GGUF) models Since you're running quantized (at UD-Q4_K_XL) , check out the "qat" models (unsloth/gemma-4-26B-A4B-it-qat-GGUF) ! - https://huggingface.co/unslo
15.
by kpw94 3mo ago
I did the opposite switch: In ~2015 got an Xbox one, as a media center it was an awesome experience: Kinect voice control to play/pause and other things way before Google home/Amazon echo ecosystem were mature. Free OTA channels v
16.
by kpw94 3mo ago
> What's hard to figure out here? Negative externalities are hard to figure out. Since parent mentions "toxic byproduct": Say you're the company that invented Teflon pans. you made billions. You saved billions in time
17.
Andrej Karpathy Joins Anthropic(twitter.com)
19 points by kpw94 4mo ago|1 comments
18.
by kpw94 4mo ago
That seems a very risky assumption for any car (self driving or human driver) during flash floods. "Turn around don't drown": You think you know how deep it is under because you've taken that road many times before (or i
19.
by kpw94 4mo ago
> And the author is correct (while the phrasing is a bit weird.) Right, that's just a description of the https://en.wikipedia.org/wiki/Baumol_effect
20.
by kpw94 4mo ago
Speculative execution techniques in software & hardware exist everywhere, - Speculative multi threading - Data Value Speculation - Speculative Memory Disambiguation - Runahead Execution - Speculative Prefetching - Multi-path (Dual-path)
21.
by kpw94 5mo ago
My non-controversial theory: It's all the attention-span-shortening stuff. - tech apps starting with infinite scroll (facebook, 9gag, Instagram, etc.) - media/tech shortened content: shorter tv shows, short video content, etc. (Ti
22.
by kpw94 5mo ago
But isn't the prefill speed the bottleneck in some systems* ? Sure it's order of magnitude faster (10x on Apple Metal?) but there's also order of magnitude more tokens to process, especially for tasks involving summarization
23.
by kpw94 5mo ago
When you say tok/s here are you describing the prefill (prompt eval) token/s or the output generation tok/s? (Btw I believe the "--jinja" flag is by default true since sometime late 2025, so not needed anymore)
24.
by kpw94 5mo ago
Right, they're not the only FAANG company for which we know they're doing it: https://news.ycombinator.com/item?id=46318494
25.
by kpw94 5mo ago
Some might be tempted to brush aside that Server Linux threat model is very different from Desktop Linux (to snarkily reply "we'll it's powering a vast majority of GDP via all of AWS, Azure, etc."). However comparing ap
26.
by kpw94 6mo ago
> I don't know how to force this issue as a European. There are just too many levels of abstraction between me and Brussels. > EU moves so much faster when it comes to regulations like forcing all of us in Denmark to use timeshee
27.
by kpw94 6mo ago
> I'll need to investigate further but it doesn't seem promising. That's what I meant by "waiting a few days for updates" in my other comment. Qwen 3.5 release, I remember a lot of complaints about: "tool ca
28.
by kpw94 6mo ago
Wild differences in ELO compared to tfa's graph: https://storage.googleapis.com/gdm-deepmind-com-prod-public/... (Comparing Q3.5-27B to G4 26B A4B and G4 31B specifically) I'd assume Q3.5-35B-A3B would perfor
29.
by kpw94 6mo ago
That's not using tech that you're describing here. You're talking about literally learning some basic computer skills (such as word processor, excel, reading email, some basic website building, use printer, and some amount
30.
by kpw94 6mo ago
The options from big companies to run untrusted open source code are: 1) a-la-Google: Build everything from source. The source is mirrored copied over from public repo. (Audit/trust the source every time) 2) only allow imports from a c

More ›