i386

7 ms·

1.
by i386 1mo ago
Its an entire misunderstanding of how the layout system works.
2.
by i386 2mo ago
Most people working at the top of these large organizations don’t know how to make anything net new anymore. They pushed all the people that do out when padding their nests.
3.
by i386 2mo ago
exo is Mac only.
4.
by i386 2mo ago
I’d love a bug report - we can get it working for you!
5.
by i386 2mo ago
Our skippy library is a patch queue on top of llama that allows us to access internal information, such as activations, and filter tensors on model load.
6.
by i386 2mo ago
To be honest, both are very tough problems we don't have a good answer for yet. If that is something that concerns you, look into building a private mesh with trusted peers.
7.
by i386 2mo ago
Each stage has its own KV for the layers it hosts. You are on the money there, when one stage is waiting it's free for more parallelism. I am planning on exploiting this for more token verification through ngram spec decoding.
8.
by i386 2mo ago
It can dynamically route. If a machine drops out of split, the topology is recalculated and the request is automatically retried.
9.
by i386 2mo ago
Thank you! AMD is a weak spot in our testing right now. If you’re willing to contribute or let us borrow some compute time, drop in on the Discord.
10.
by i386 2mo ago
The lab features two Mac Studios: an Apple M3 Ultra (32 CPU cores, 80 GPU cores, 256 GB unified memory) and an Apple M1 Ultra (20 CPU cores, 48 GPU cores, 128 GB unified memory), both connected via 1Gbit Ethernet. We use a customized Q2 qua
11.
by i386 2mo ago
That isn’t true. llama RPC is incredibly slow but staged splits in skippy are orders of magnitude faster.
12.
by i386 2mo ago
This was done on my home lab simulating 5ms latency and jitter between machines. Splits work quite well if you your nodes are over WAN at metro latency’s but not super fast on global WAN. The idea is that you could take several machines wit
13.
by i386 2mo ago
I’m one of the contributors to Mesh LLM and happy to answer any questions. I authored the skippy engine that allows you to split large models across nodes.
14.
by i386 5mo ago
PMs at Microsoft have incredibly bad taste
15.
by i386 5mo ago
I kinda fucking love it. He’s doing something. It’s interesting. There’s no scam. Let live!
16.
by i386 6mo ago
You can try this new model live using mesh-llm right now: https://www.anarchai.org/dashboard
17.
by i386 6mo ago
switch on version, then messageId…
18.
by i386 6mo ago
> I didn't know that Protobuf wasn't canonical but even without this knowledge, there are many other factors which make it an inferior format to JSON. If strict typing and versioning are useless to you, sure.
19.
Pool spare GPU capacity to run LLMs at larger scale(github.com)
11 points by i386 6mo ago|3 comments
20.
by i386 7mo ago
yeah this product does not exist
21.
by i386 8mo ago
I work for YouTube. You’re hired.
22.
by i386 9mo ago
At the WiseTech office in 2006 we had a small shrine in the corner dedicated to Tridge, the patron saint of hackers.
23.
by i386 10mo ago
This is very revisionist. While they have been catching up quickly there was no master 4D chess strategy here. Google was incredibly late to this game - Sergey had to come back from retirement because most of the research team had a Sarah C
24.
by i386 11mo ago
Android supremacy at its finest. I would never recommend a family member buying one. The history of this kind of thing is long and keeps continuing to happen.
25.
by i386 1y ago
> What makes a group of coworkers into "an org"? Reporting lines that ladder up to a line in the P&L.
26.
by i386 1y ago
Honestly good luck. I left a company and removed myself from the meta account which triggered the deletion of our whole app. Impossible to recover. Meta suck.
27.
by i386 1y ago
LOL
28.
by i386 2y ago
Very rude. Just because you work for The Register doesn’t mean you can bring your toxicity here.
29.
by i386 2y ago
Not sure why this is downvoted. Economic activity should be enjoyed by the commons. For example LNG being exported UNDER international value and Aussies buying it at international prices is idiotic.
30.
by i386 2y ago
Three words: left hand drive.

More ›