electronsoup

7 ms·

1.
by electronsoup 3mo ago
Yeah MoE is a little worse for the same size, but you can often run bigger MoEs at respectable speeds even on cpu ram offload. The dense models really need to be 100% vram
2.
by electronsoup 3mo ago
> It gets into loops quite often, and surprisingly often gets the edit tool call wrong I find that running better quantization, like Q8 tend to prevent this even though its a bit slower to run, it saves overall time with less churn Using
3.
by electronsoup 3mo ago
> in secret is impossible without the whole world knowing. I'm curious about why this is Outside of an actual test detonation, presumably this could all happen in a secure place?
4.
by electronsoup 3mo ago
They didn't say they had never traveled south though
5.
by electronsoup 3mo ago
If you put that behind an API, you could sell the service much like the AI providers
6.
by electronsoup 3mo ago
Why this is not a PR for llama.cpp
7.
by electronsoup 4mo ago
> likely not well thought out Or it has been, and cruelty is the point
8.
by electronsoup 4mo ago
Surely this will get arbitraged like anything else, where fans who get picks will onsell tickets
9.
by electronsoup 4mo ago
So now we need to run farms of spotify accounts playing songs to get our concert tickets?
10.
by electronsoup 4mo ago
You may need to move on to other services like Apple Music
11.
by electronsoup 4mo ago
So how many of their employees are now familiar with the codebase? zero?
12.
by electronsoup 5mo ago
At what point does spanish internet become too unreliable? There was a thread the other day about someone's CI jobs failing due too this.
13.
by electronsoup 5mo ago
> the GPU apps we are building with them are I can't help but get the feeling you have use-case end-goal in mind that's opaque to many of us who are gpu-ignorant. It could be helpful if there were an example of the type of appl
14.
by electronsoup 6mo ago
> worth their salt That's a big assumption. Often there's no time to do things right, or no money, or lack of oversight, and so on. Not every company is staffed by empowered and highly motivated staff
15.
by electronsoup 6mo ago
and most OS do enable it by default
16.
by electronsoup 6mo ago
Whenever I see a chip like this, I think "why wont my company let me use a decent computer"
17.
by electronsoup 6mo ago
Which mainboards are cheap and have 4 pcie16x (electrical) slots, that don't need weird risers to fit 4 GPUs
18.
by electronsoup 6mo ago
If it was so important, wouldn't he just filibuster it till he got what he wanted?
19.
by electronsoup 6mo ago
> but then again you need to plausibly explain why was someone operating your car while you were not aware of it. There is no such requirement.
20.
by electronsoup 6mo ago
> and they're just as capable as using AI as anyone Wouldn't the assumption be the opposite, in that AI is magnifying the decision making of the engineer and so you get more payback by having the senior drive the AI?
21.
by electronsoup 7mo ago
I guess the end of copyright is near if this is fine to put on a corporate website
22.
by electronsoup 7mo ago
That's some weird gatekeeping. The hardware they do support is supported well.
23.
by electronsoup 7mo ago
Perhaps they mean ISAs
24.
by electronsoup 8mo ago
oh awesome! I had assumed they were just targeting M1/M2 for the time being
25.
by electronsoup 8mo ago
> The only way to accomplish this at scale is to build something that is legit better and let the market decide. Anything else is just principled wishful thinking. No they need to tariff/ban things that are non-EU
26.
by electronsoup 8mo ago
How effective would this setup be if the parent company in the US is ordered to order the EU subsidiary to do something not in the interests of the EU?
27.
BugStalker for Rust(godzie44.github.io)
1 points by electronsoup 8mo ago|0 comments
28.
by electronsoup 8mo ago
I'm curious about the iOS situation