spott

7 ms·

1.
by spott 4d ago
It likely cost them more than a million in compute to solve it…
2.
by spott 4d ago
That is why I added the last line. But I also doubt Nvidia is on the hook if OpenAI just no longer wants the compute. I bet they are only on the hook if OpenAI cannot pay for it (is insolvent in some way). I also have to bring up that
3.
by spott 4d ago
Yea, but they would have to become insolvent in a way that makes compute lose value. The reason Nvidia is comfortable making these deals is because if OpenAI can’t use the compute, someone else can. Granted OpenAI going insolvent likely mea
4.
by spott 10d ago
I don’t think I’d even have perplexity on this list. Claude or OpenAI. I’m not sure what the value of perplexity is these days.
5.
by spott 20d ago
Why is there no link to the source? The whole point of the article is about that link. Anyways, I found it here: https://github.com/Modos-Labs/Glider
6.
by spott 21d ago
Banning import/sale of the product into the US is worth a hell of a lot.
7.
by spott 1mo ago
World building, story boarding/ story arc building, etc are great uses for an LLM in fiction.
8.
by spott 1mo ago
Sure. It would also wreck Japan.
9.
by spott 1mo ago
“Biggest holder of us treasuries” 3.1 percent. Just for context.
10.
by spott 1mo ago
It depends on how that debt is owned. If I go to a bank, and I get a loan, then the terms of that loan allow the bank to do that. If I sell a bond , then I set the terms, and I say that you can’t do that. You buy the bond understanding
11.
by spott 1mo ago
How would china “make the call on us debt”? That debt is all treasury securities bought on the open market. They can’t demand the US pays them back early any more than you can.
12.
by spott 1mo ago
It is kinda a combination of the two: https://github.com/spott/pi-task-compaction I’m still playing with it, but it essentially has the model define a region, and mark it with begin_task, and end_task. End_task also r
13.
by spott 1mo ago
https://jerrypournelle.com/reports/jerryp/iron.html Any organization is eventually controlled by people more interested in the organization than its mission. Or something to that effect. (Accidentally attached th
14.
by spott 1mo ago
I think it died before that, it was just that buried it then.
15.
by spott 2mo ago
Forth I assume uses reverse polish notation: arguments before the operator. 3 4 + for example, would return 7.
16.
by spott 2mo ago
Probably just not post-trained well enough. I think the argument that pre-training gives a lib-left model is probably correct, so Grok, pre-post-training has a lib-left bend, then they try and post-train it. I imagine it is hard to post-tra
17.
by spott 2mo ago
huh? ``` curl -fsSL https://x.ai/cli/install.sh | \ llm -s "Review this shell script and tell me what it does" ``` That isn't unauditable trust...
18.
by spott 2mo ago
Is this open source? I can't find a link to download the weights.
19.
by spott 3mo ago
Why would they spend a ton of effort ensuring that their customers spend less money on them? Token economics also are weird. If you design a fancy new frontend that for example uses a cheap model to parse a PDF into text that is fed into a
20.
by spott 3mo ago
You aren't looking for a random set of tokens that have the exact same logit, you are looking for the largest n tokens to have the exact same probability. This is exceedingly unlikely, as training will only push one of them up for an
21.
by spott 3mo ago
Which products are outstanding in their categories? Gmail isn't outstanding, search isn't outstanding, maps isn't outstanding. They are all pretty par for the course. Google used to be outstanding... but I'm not sure
22.
by spott 4mo ago
Is there a paper on this? I'm curious how they pre-trained it... I feel like it must have had audio/image output that they chopped off. I wonder how hard it would be to add it back on.
23.
by spott 4mo ago
https://newsletter.maartengrootendorst.com/p/a-visual-guide-... (in a link from here: https://developers.googleblog.com/gemma-4-12b-the-developer-... , which was linked in the text of the post, but not
24.
by spott 4mo ago
This is just early fusion basically. FAIR did this 2 years ago now: https://arxiv.org/abs/2405.09818 I've been waiting for something like this to be released since then. The annoying thing is that chameleon was m
25.
by spott 7mo ago
This could just be because everyone is using direct OpenAI api keys when using OpenAI.
26.
by spott 7mo ago
Yea, they are just much higher level programmers… most programmers don’t know the low level syscall apis.
27.
by spott 7mo ago
Does ssh need to allow root logins? Sshing as a regular user and then sudo to root works 95% of the time…
28.
by spott 8mo ago
Typo? Or morbid question?
29.
by spott 8mo ago
I think of it differently. Before, you measured diffusion rate of oxygen and inferred oxygen concentration from that (the concentration outside the chamber is always greater than the concentration inside). Dirty membranes etc all changed t
30.
by spott 8mo ago
This might be it: https://www.eizo.com/products/flexscan/ev2730q/

More ›