ericd

7 ms·

1.
by ericd 4d ago
Ah good catch on the total tokens, was going off vague memory there, and I thought people had gotten qwen 3.8 27b up to similar decode speeds as ds v4 flash. >One data point that seems relevant to me is that the previous gen qwen Qwen3.6
2.
by ericd 4d ago
Thanks! That's very helpful as a way to discuss. First off, I'd include Qwen flash-next and GLM 5.3 to show some of the other strong open weight models, and they predictably dominate it, but they're much larger. But, it shows
3.
by ericd 4d ago
Ah sorry, I should've continued, the bigger recent models are commensurately smarter. If you really want to make the point, then you'd need to show 27b being smarter than similar vintage bigger models. And in that case, there&#x27
4.
by ericd 4d ago
Gpt-oss—120b is like 1000 years old in AI years, whereas Qwen 3.8 27b is pretty young. What you’re seeing is that parameters aren’t apples to apples, and at a given parameter level, the new models are much, much better than the ones from a
5.
by ericd 5d ago
Yeah, it's really tough, there's so much potential good, and so much potential bad. My intuition says that decentralized will probably be better, the other way seems to concentrate power while also not really keeping it out of the
6.
by ericd 5d ago
Really? You’ve spent the time to learn every member of the EU government that supported them? And you think that’s a good use of everyone’s time? I guarantee you that the average US citizen hasn’t bothered to do that with even their members
7.
by ericd 5d ago
No, I don't blame China or India for continuing to do business with Russia, it seems completely rational for them to do so. They're powerful enough to ignore the structures the US has built to try to exert leverage internationally
8.
by ericd 5d ago
To be clear, I don't think they're doing it because they want all the money, I think they truly believe that this is existentially threatening, and are trying to regulate their open source competition away because they think that&
9.
by ericd 5d ago
Geopolitics is way too complicated for such black and white thinking. Do you know who amongst the governments of those countries decided to back this Syrian president? I certainly don't. What percentage of the (huge) populations that y
10.
by ericd 5d ago
But also, the US makes more oil than it uses. With some nuance around how the refineries are set up vs type of crude produced.
11.
by ericd 5d ago
It's not naivete/goodness, this is totally aligned with their playbook of trying to get AI to be heavily regulated.
12.
by ericd 10d ago
Presumably you can install your own and have the electrician to the final connection to the grid/your house? Solar panels are much, much cheaper than you seem to think.
13.
by ericd 10d ago
Really? That's more expensive than I would've guessed. The US has substantial tariffs, and you can get a pallet of panels for $0.20-$0.30/watt. You can also pay a lot more, but I'm not sure why you would.
14.
by ericd 10d ago
$1000 panel? I’m pretty sure 600 watt panels are coming in at <$100 on the global market. Prices have come down a lot in the past decade.
15.
by ericd 10d ago
My understanding is that it’s the thin film variant that’s “famously poisonous”, the Cadmium Telluride ones. But that’s not the type that almost any field full of solar is made up of.
16.
by ericd 12d ago
Yeah, I'm guessing this isn't unique, but I remember the first time I used ChatJimmy, I missed the fact that it had responded because I was still hitting the enter key, and getting ready to see tokens stream in, but they were alre
17.
by ericd 12d ago
Yeah, it'd be a lot easier to maintain flow, less need to work on more than one session at once, etc. And then tool calls would be the limiting factor, especially network access. I hope AMD keeps the project moving forward post acquisi
18.
by ericd 13d ago
Sure, Google could be their agent, or ChatGPT, or Claude, or whatever local model the person is running. The big guys might all have the results cached so they don't have to rerun the crawl. Whatever their choice of agent, it seems pre
19.
by ericd 13d ago
Nah, Taalas was putting the weights into silicon as a mask ROM. Their demo chip was hardwired to serve Llama 3.1 8B, and could never be updated. New models, even new versions without any architectural/size changes meant new tape outs.
20.
by ericd 13d ago
The sites that do that won't be getting money from my and others' agents. Guessing that's going to become more and more of a problem for those sites.
21.
by ericd 13d ago
Ahh yeah, I've seen people using those. I was thinking you'd ideally want to connect them full speed, but it looks like they're 200gbps ports anyway, and I guess even if they were 400gpbs, you don't really need that much
22.
by ericd 13d ago
No, the asic could only ever run one model/set of weights, no updates possible, ever. These are general purpose processors that can have their models updated. But the chips are enormous, with a substantial amount of on-die memory along
23.
by ericd 13d ago
Well, this one only has 4 ports, would you daisy chain them somehow to get to 8? Or bridge three of these switches?
24.
by ericd 13d ago
Yeah, my cousin had one, was like a computer from a parallel evolution chain, kind of weird, but kind of awesome.
25.
by ericd 13d ago
Yeah, someone reverse engineered Red Alert 2 recently. Took Fable cranking for almost a month, but it's pretty amazing to see.
26.
by ericd 13d ago
Wow, that's gorgeous for something written in assembly, running in 512k, nice work!
27.
by ericd 13d ago
Well, is there a clear route to being a >$10B business? If not, it's probably not a good match for VC. But that's OK.
28.
by ericd 13d ago
Essentially, yes. The DGX Sparks, at 128 gigs for ~$4700 are one of the cheapest ways to get enough high-ish speed memory cobbled together to run one of the more capable open weight models to run at home/for a small biz. This switch le
29.
by ericd 14d ago
Oh, nice haha, way better. And no worries, I'm actually waiting on a quote/timeline from them anyway.
30.
by ericd 15d ago
Ah yeah, one of mine is from Central. And yeah, crazy how much they've gone up. But I can see why, they scream.

More ›