marci

8 ms·

1.
by marci 14d ago
After looking at freely available SVGs of pelicans and bicycles, I have a hard time imagining what they could be using to game this.
2.
by marci 1mo ago
delta.chat is email https://delta.chat/en/help#can-i-use-a-classic-email-address...
3.
by marci 1mo ago
Then maybe what you want is email? Sprinkled with a little bit of https://delta.chat ? And potentially a dash of iroh https://news.ycombinator.com/item?id=48542480 https://www.iroh.computer/solut
4.
by marci 1mo ago
Nothing to understand. Straight up hallucination. I could have sworn I read that they used a novel architecture where the model is dense but you could select specific layers or something at inference. reread the announcement: just said MoE.
5.
by marci 1mo ago
Seems like what Apple's going for with afm3. Their latest model that will be embedded in macOS 27 is a quantized dense 20B that only select between 1 to 4B at inference, based on the prompt, not token by token. If only they could make
6.
by marci 2mo ago
https://xcancel.com/Alibaba_Qwen/status/2084100707423289643#...
7.
by marci 2mo ago
Makes me wonnder... how much compute/storage there's in all the satellites currently in LEO combined.
8.
by marci 3mo ago
This was a preview release. They haven't finish training. The Pro contains more knowledge but it probably takes longer training than flash for the smarts to kick in.
9.
by marci 3mo ago
"That’s where EMO comes in. We show that EMO – a 1B-active, 14B-total-parameter (8-expert active, 128-expert total) MoE trained on 1 trillion tokens – supports selective expert use: for a given task or domain, we can use only a
10.
by marci 3mo ago
But with Apple's AFM 3 architecture, we might end up with huge SOTA adjacent on devices with limited RAM. They use a technique where you only load between 1B and 4B of a 20B dense model for an entire prompt run, not token by token like
11.
by marci 3mo ago
Don't worry. Most people spend most of their compute time on a phone, where you're ability to filter ads is way more enshitified.
12.
by marci 4mo ago
I wonder where's the line between using a font and copyright/trademark infringement.
13.
by marci 4mo ago
"That’s where EMO comes in. We show that EMO – a 1B-active, 14B-total-parameter (8-expert active, 128-expert total) MoE trained on 1 trillion tokens – supports selective expert use: for a given task or domain, we can use only a small s
14.
by marci 4mo ago
Did they modify their post? I can't see who claimed that consumer hardware will be able to build most things?
15.
by marci 6mo ago
when you sign an app with your personal dev account.
16.
by marci 6mo ago
That's just a regular rounndabout. I thought you were talking about this: https://www.youtube.com/watch?v=6OGvj7GZSIo
17.
by marci 6mo ago
Also everything from scratch by allen.ai. Weights, datasets, code, multiple checkpoints... I like their FlexOlmo concept.
18.
by marci 6mo ago
I think it's mostly because most cpus that can run a gpu already have parts dedicated as h264 encoder, way more efficient energy wise and speed wise.
19.
by marci 7mo ago
Unfortunately, the most extreme is that it's the new normal that now, there's >0 chance that someone, whether they are a US citizen or not apparently, child or adult, can end up in a camp, with no due process.
20.
by marci 7mo ago
Imagine, a llm trained on the best thrillers, spy stories, politics, history, manipulation techniques, psychology, sociology, sci-fi... I wonder where it got the idea for deception?
21.
by marci 8mo ago
Their issue with the mac was the sound of fans spinning. I doubt a dedicated gpu will resolved that.
22.
by marci 8mo ago
"finetune" Not "Train from scratch"
23.
by marci 8mo ago
It is so, so long... I barely reached the middle before my brain just "Nope." They are talking about this kind of battery replacement: https://www.ifixit.com/Guide/Fairphone+3+Battery+Replacement... . The &qu
24.
by marci 8mo ago
If your family members ever had to mount an ikea furniture or equivalent, they'll probably have an as easy or easier time replacing a part on a fairphone. Especially for the battery. At least for version 3 and older. I don't know
25.
by marci 9mo ago
This is the draft, not the current version. edit: and for the current unfortunately there's only a dead dropbox link.
26.
by marci 9mo ago
When they bothered compensating, it was far from market value, so no.
27.
by marci 9mo ago
It makes more sense to word it like this when you take into consideration historical trends, like drowned towns for lakes or dams, highway system along redline, thriving neighbourhoods erased to create parks… often preceded by violence and
28.
by marci 9mo ago
In other words, sometimes, things happen in reality that, if you were to read it in a fictional story or see in a movie, you would think they were major plot holes.
29.
by marci 10mo ago
Thinpkad owners/modders, probably.
30.
by marci 11mo ago
Any repo? even if not production ready. I'm curious about how you approached replication, compared to mnesia or couchdb, especially now that erlang natively supports json.

More ›