sosodev

7 ms·

1.
by sosodev 5d ago
I’ve wanted something like this for a long time. However, I wanted it with extensive fact-checked information and AI slop is the opposite of that so I feel this is kinda pointless.
2.
Patience Is Required for Local AI(kylemcgough.com)
16 points by sosodev 21d ago|2 comments
3.
Ripping Off the Hey.com Band-Aid(kylemcgough.com)
36 points by sosodev 22d ago|4 comments
4.
by sosodev 22d ago
Yeah, but that computer can’t also do the AI stuff. And not everybody has a desktop with multiple 32GB GPUs available. I’ll admit though I’m biased because I bought my board for $1600 back before the prices went crazy.
5.
by sosodev 22d ago
That’s only true if you think AI is the only reason to own a powerful and efficient server. Mine does plenty of traditional server stuff too.
6.
by sosodev 28d ago
One agent typically blocks the others on a local device because the GPU is already completely utilized either in terms of memory or compute. You can have true parallelism at home, but you need an absurd amount of resources. It's not a
7.
by sosodev 28d ago
What about do you mean by single threaded? Each token is predicted by using parallel computation on the GPU.
8.
by sosodev 28d ago
That's not how that works. Selecting a different token is not inherently erroneous. A correct solution can still be found despite divergence.
9.
by sosodev 28d ago
Ruby can't render React code. JavaScript can. With GitHub it seems that they sometimes can do SSR for the React bits, but that must mean that they're invoking a JavaScript interpreter within the Ruby process. Which means they have
10.
by sosodev 28d ago
SSR that is javascript native, sure. This is still Ruby doing the rendering.
11.
by sosodev 29d ago
They didn't leave the architecture alone, right? They shoved React in and created a weird SSR + React frankenstein that is objectively worse in many ways.
12.
by sosodev 1mo ago
Ah, yeah that's a fair point. I was thinking it'd be something the labs themselves, or other companies with billions of dollars in funding, would tackle. The labs seemingly have the most to gain since such a system could be used f
13.
by sosodev 1mo ago
I don’t find that to be particularly systematic because it’s still so haphazard. It’s like asking Claude to vibe code you a website.
14.
by sosodev 1mo ago
I had an old coworker who told me he got into software development in the sixties by walking into an IBM office and asking for a job. He had no education beyond high school and no experience with computers. They just had him take an aptitud
15.
by sosodev 1mo ago
Very true. Humans have historically tried to systematically reduce the search space and only dedicate their "compute" to things that seem highly likely to yield results.
16.
by sosodev 1mo ago
I wonder why we have yet to see more systematic exploration of Math. Anthropic describes that Claude identified a set of possibilities and then explored them using sub-agents. The human saying "I believe in you" could literally ju
17.
by sosodev 1mo ago
> Congratulations on being a vegan. 20% of the population doesn't have health insurance. These two things are completely unrelated.
18.
by sosodev 1mo ago
I saw some coverage of your robot on social media. I honestly thought it was a hoax because of the very bold design and AI generated images. Cool concept, have you had any potential customers reach out?
19.
by sosodev 1mo ago
> AISI provided the AI agents with internet access during these evaluations, which enabled their actions on the open internet in this setting. Internet access was a deliberate part of AISI’s evaluation configuration in this setting, and
20.
by sosodev 2mo ago
Looks like I might have a reason to use something other than Deepseek V4 Flash.
21.
by sosodev 2mo ago
I wonder how many people are using external resources when playing this. I have a hard time believing that the average lumps so far to the right of the score distribution unless this game is played exclusively by anthropologists haha.
22.
by sosodev 2mo ago
Are guard rails meaningful if they can be removed from the weights? Can America even prevent the release and proliferation of these models? It seems obvious to me that the whole question of regulating a file is a bit silly. Any law that pus
23.
by sosodev 2mo ago
They reference https://thinkingmachines.ai/blog/on-policy-distillation/ If I understand correctly, it's distillation via having a teacher model score each of the student's tokens for a problem based on t
24.
by sosodev 2mo ago
I think the argument is that decentralization leads to deceleration because it means less centralized funding and data. Those are the two primary ingredients for accel. The problem with the decel/accel rhetoric is that it lacks nuance.
25.
by sosodev 2mo ago
If you only care about facts, maybe. Even then I'm sure there are countless facts not described outside of old books. I have a hard time believing that text valuable to humans would not be valuable to AI.
26.
by sosodev 2mo ago
GSX seems interesting but I don’t understand why it depends on the node ecosystem. I just want to use Go for everything.
27.
by sosodev 2mo ago
What would "actual" evidence look like? I have a hard time believing that if they released the logs that people would take it more seriously. The temptation would be to say "they fabricated those for marketing". Just as
28.
by sosodev 2mo ago
Realistically you can't prevent distillation. OpenAI / Anthropic are slowly moving towards hiding the steps in-between input and output (hidden thinking), but that only helps so much. Imagine you put a file into Claude and say &qu
29.
by sosodev 2mo ago
Model distillation can't be stealing at all if you rationally apply copyright law to it. Anthropic is not deprived of Fable so there is no theft. At best it would be infringement, but even that might not hold up in the courts given the
30.
by sosodev 2mo ago
Distillation is a very vague term. It can mean anything from training exclusively on a model's output to using it for a very small portion of the training. In this case it is almost certainly towards the very small portion side of the

More ›