drewnick

6 ms·

1.
by drewnick 1mo ago
The KV cache is a great example. When you own hardware, vllm etc can keep your KV cache warm indefinitely for bursty large token loads vs clouds will purge quite often. One of my tasks has a very large but very static system prompt and inst
2.
by drewnick 1mo ago
AMD AI Halo machines are similar cost and RAM. I'm in the market and comparing both. The new 192GB AMD box will be tempting but I'm leaning 2xDGX's for now.
3.
by drewnick 1mo ago
+1 I have found extremely reliable systems require a mix of deterministic "adapters" is a good word for agents to actually get through the workflows I've created. I'm still amazed that it can work with both those and so
4.
by drewnick 1mo ago
An hour in, I've been running four terminals full bore on my $20/mo Grok sub and I'm at 9% for the week. Codex or Claude would easily have hit 5-hour or weekly limits.
5.
by drewnick 1mo ago
Think about how many webmaster and business owners' egos are stroked by all the traffic they are getting, when in actuality they are often just serving thousands of bots.
6.
by drewnick 2mo ago
I moved one of our daily workflows over to Kimi K3 on Fireworks. It replaces two sales assistant positions, and was about $50/day for 14 million tokens total (in/out). They surely are not subsidizing this price as it is just inf
7.
by drewnick 2mo ago
Thank you for giving us this nuance.
8.
by drewnick 4mo ago
Wow, this is refreshing DX compared to iterating all messages like we did back in '24.
9.
by drewnick 4mo ago
While all these models are nondeterministic a feature bump is still necessary as the same input can have wildly different output on a new model. For API users being able to pin a model is a necessity.
10.
by drewnick 5mo ago
Great point on the playing with Linux growing up, it's second nature to me now. I am always feeling like I'm doing something wrong running bare metal based on modern advice, but it's low latency, simple, and reliable. Probabl
11.
by drewnick 5mo ago
The problem is a lot of this glue is proprietary by design at the various cloud services. I realize there are open source and alternative abstractions for a lot of of the same services, but there’s still quite a bit of glue if you’re on AWS
12.
by drewnick 5mo ago
I too, am bravely using Claude for more DevOps. I run all of my virtual machines on proxmox atop bare metal servers I own and I’m just blown away at how quickly Claude can optimize and set up entire new networks across all of these machines
13.
by drewnick 5mo ago
Agree. If you've ever spent serious time in the country with farmers, the level of ingenuity is impressive among many, and they benefit from it greatly. As the grandson of depression farmers, I noticed intelligence mattered a lot, even
14.
by drewnick 5mo ago
Hasn't Opus 4.5 been famously consistent while 4.6 was floating all over the place?
15.
by drewnick 5mo ago
I think this is more about which model you steer your coding harness to. You can also self-host a UI in front of multiple models, then you own the chat history.
16.
by drewnick 5mo ago
Same, mostly. However today in particular Claude can't do front-end development with any competence. Never seen this before. I think the rumor is they are rolling out a new model and have to divide their infra across the new model v
17.
by drewnick 6mo ago
You can use Claude Code with API mode (not a sub)
18.
by drewnick 6mo ago
You should definitely log in to Google Cloud Console and roll all the keys you see in there if you're unsure. I just did the same thing after I realized I had a lot of surface area with these keys.
19.
by drewnick 7mo ago
My bloody stool started slow and took some time off but came back and I had a large polyp. Watch this very closely, but don't panic.
20.
by drewnick 7mo ago
Blood in the stool, at age 41. Benign but a VERY large polyp so I have a followup soon. If you have an instinct to get tested, especially if you have any evidence, do it. My doc fought me to NOT get tested but I persisted. The embarrassm
21.
by drewnick 7mo ago
I've gotten sucked into 1950s/60s/70s Pan Am (the defacto U.S. flag carrier of the era) advertising videos and the concept is similar to AT&T: premium service, basically a monopoly. Problem is: prices were REALLY high. Co
22.
by drewnick 7mo ago
Somehow I was recommended the /r/longlines subreddit, so I subscribed. I now get pretty much a daily picture of a Long Lines abandoned tower somewhere in the country with upvotes and discussion. It is fascinating the hobbies peo
23.
by drewnick 10mo ago
Same here - 12y. I've learned so much and one day hope to contribute back something significant to the community but haven't found a footing just yet.
24.
by drewnick 10mo ago
Upstate South Carolina as well
25.
by drewnick 11mo ago
I've been doing it since 1998 in my bedroom with a dual T1 (and on to real DCs later). While I've had some outages for sure it makes me feel better I am not that divergent in uptime in the long run vs big clouds.
26.
by drewnick 1y ago
Not OP, but I use Codex for back-end, scripting, and SQL. Claude Code for most front-end. I have found that when one faces a challenge, the other often can punch through and solve the problem. I even have them work together (moving thoug
27.
by drewnick 1y ago
For bare metal I’ve been using tier.net to get 192 GB RAM, 4TB NVME and 32 cores for $219/mo. Data centers all over the country and I get to locate under 10ms from my regional audience. Just a data point if you want some bigger iron th
28.
by drewnick 1y ago
Note this affects TETRA which is not used in North America. Most US systems use P25 which is not mentioned in the article.
29.
by drewnick 1y ago
Thank you! This just saved me after closing laptop and losing a chat in VS Code. Cool feature and always a place where Clause Code UX was behind chat - being able to see history. "/continue" saved me ~15 minutes of re-esta
30.
by drewnick 1y ago
I too have noticed variability and it's impossible to know for sure but late one Friday or Saturday night (PST) it seemed to be brilliant, several iterations in a row. Some of my best output has been in very short windows.

More ›