philipportner

6 ms·

1.
by philipportner 7d ago
Wasn't aware of all of those, thanks for sharing.
2.
by philipportner 18d ago
> Are Rubber Ducks offloading thinking? Just that an actual rubber duck doesn’t do anything. You solve the problem you have by talking, and in doing so, thinking, to come up with a solution, an idea, or gain better understanding. After t
3.
by philipportner 28d ago
Linked a the bottom of the post is the angry version https://dontpastetheai.com/angry/
4.
by philipportner 1mo ago
How do you keep up with such information? Any sources you could recommend? Closest I know would be SemiAnalysis
5.
by philipportner 1mo ago
Good point, thanks! I haven't been keeping up with most of the new model internals.
6.
by philipportner 1mo ago
You'd need hundreds of GB alone for the KV cache of each user. For something like LLama 3 405B you need ~67GB at ~130k tokens. A single CS-3 has 44GB on-chip sram. So, afaik, Cerebras are optimizing for ultra-low latency batch=1 infere
7.
by philipportner 1mo ago
Congrats on the great job with the Altar II. If I didn't already have too many keyboards, I'd hop on the Kickstarter! FWIW, I fully agree with your opinion on including a `half working` fingerprint sensor.
8.
Prevent cognitive debt by manually retyping LLM-generated code(ankursethi.com)
4 points by philipportner 2mo ago|1 comments
9.
by philipportner 2mo ago
if you assume that training requires about 3x the compute of inference (one forward pass, one backward pass, parameter updates), and we take DeepSeek-V3 since their numbers are public. they used ~14.8 trillion tokens with about 2.66 million
10.
by philipportner 2mo ago
Hasn't changed at all since AI agents became a thing. tmux, nvim with a few plugins, mainly fzf and LSP support. If I do use an AI agent, I just run it in another tmux window.
11.
by philipportner 3mo ago
> I'm not sure you can prompt a full, accurate, copy of a nontrivial codebase out of them. Even with zero temperature their accuracy is just not that high. Granted, these are some of the most widely spread texts, and not codebases,
12.
by philipportner 4mo ago
> My favorite side effect is that I now love all foods. Prior to this, I was a rather picky eater. Now I love everything! I feel like there's a burntsushi joke hiding in there somewhere. All the best Andrew.
13.
by philipportner 4mo ago
They reference the gist of 1cg in the honor code section of CS336. https://cs336.stanford.edu/
14.
by philipportner 7mo ago
FYI: Claude has output styles, one of them is called `learning`. Instead of writing the code itself, it will add `TODO(human)` and comments to explain how to. Also adds `Insights` explaining concepts to you in its output. This link also has
15.
by philipportner 7mo ago
Did you publish anything you could link wrt. query rewriting?
16.
by philipportner 7mo ago
Granted, these are some of the most widely spread texts, but just fyi: https://arxiv.org/pdf/2601.02671 > For Claude 3.7 Sonnet, we were able to extract four whole books near-verbatim, including two books under copy
17.
by philipportner 7mo ago
This seems related, it may not be a codebase but they are able to extract "near" verbatim books out of Claude Sonnet. https://arxiv.org/pdf/2601.02671 > For Claude 3.7 Sonnet, we were able to extract four
18.
by philipportner 10mo ago
There's a link to the AoCO2025 tag for his blog posts in the op.