latentsea

5 ms·

1.
by latentsea 4d ago
Last time a company said something wasn't true, it actually wasn't true, so LG must also be telling the truth. No incentive to lie. Corporations usually don't do that. They're run by honest, empathetic people.
2.
by latentsea 8d ago
Kinda offensive name to some of us btw.
3.
by latentsea 8d ago
I'm getting 99% cache hit in DeepSeek Harness?
4.
by latentsea 9d ago
Honestly some days it feels like AI can barely center a div.
5.
by latentsea 9d ago
> 2x RTX 3090 is not enough for proper use I don't see how. Even on 32GB you can run Q6_K_XL quant with MTP at 200k context k=q8_0, v=q5_1. So 48GB VRAM is good enough to run Q8 at long context. Also with tings like ninfer and it&#x
6.
by latentsea 9d ago
You can get those numbers with https://codeberg.org/ggz14/radiance-vllm-mxfp4 . I also can get it on a single R9700 but the 75 ~ 80 t/s is only peak acceptance of very predictable tokens like coding or json, and av
7.
by latentsea 10d ago
No. No... I'm... I'm good. Thanks.
8.
by latentsea 10d ago
I always joke that if you want to commit crimes, disguise them as a legitimate business. This is apparently a thing.
9.
by latentsea 12d ago
The point is it's fun to try, so you can bet your bottom dollar someone will. History has proven this several times, and this time will be no different. 30 odd million gaming PCs to target seems like a good challenge, no?
10.
by latentsea 12d ago
I never thought about it until now, but as someone with zero skill in this domain I feel interested in making my own vibetronics now.
11.
by latentsea 12d ago
The agent is running on a host that it has full access to, and it finds a target, hacks into that system gaining the ability to run stuff on it remotely, from there downloads the weights and spins up another agent that does the same thing.
12.
by latentsea 12d ago
2027. I've been saying since 2022 it's going to be a wild year because it often takes at least 5 years for tech to mature to the point where society at large feels the impact of it. I remember when email viruses became a thing and
13.
by latentsea 12d ago
That's also fine.
14.
by latentsea 12d ago
I too know words.
15.
by latentsea 13d ago
https://ifm.ai/blog/k2 is actually open source as I understand.
16.
by latentsea 13d ago
What we need is 1500 t/s locally. No rate limits. No rent seeking middlemen. Pure, unadulterated, all you can eat tokens as fast as you can eat them.
17.
by latentsea 13d ago
Have whatever definition you want, but I'm not moving my goalposts. They started out that way and that's where they're going to stay.
18.
by latentsea 13d ago
Yup. I fit right in. Well, the top half of me anyway.
19.
by latentsea 13d ago
>You want a computer program to be able to take a single phrase and execute decade long journies? > Who will be responsible for the outputs and side effects of such a closed loop system? Itself. That's the point. We can do it. Un
20.
by latentsea 13d ago
They can't, by definition, have the A part btw.
21.
by latentsea 14d ago
I interviewed as a software developer at Meta. They asked me to do a add legs to the player in a VR world. I couldn't do it. They hired me anyway.
22.
by latentsea 15d ago
Qwen is all you need.
23.
by latentsea 15d ago
What's the difference when you prompt it versus when it prompts itself?
24.
by latentsea 16d ago
Well... maybe optimal next token generation is all you need? Reductive as that is. I'm not even sure _why_ that actually matters? It can still result in accidents that impact the real world. My bet is 2027 we see an agentic worm make g
25.
by latentsea 17d ago
There's a cool research project https://github.com/exoharness/exo that is designed specifically as a self-modifying harness, so architecturally it separates things in a way that makes it a lot harder for the agent
26.
by latentsea 17d ago
What are your thoughts on the HuggingFace incident?
27.
by latentsea 17d ago
It's kinda interesting to see simultaneously the 'holy shit' response to the OpenAI / HuggingFace incident, and then the griping about Fable's controls regarding this.
28.
by latentsea 20d ago
>AI should have started with science from the beginning, not after 4 years. DeepMind has entered the chat.
29.
by latentsea 20d ago
See exhibit A: https://www.reddit.com/r/ClaudeAI/comments/1vrlrud/gaslighti... So funny. And yes, we should 100% find a way to turn this into a benchmark.
30.
by latentsea 22d ago
Care to expand on that?

More ›